2023-04-09 15:53:32,150 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-04-09 15:53:32,423 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404 2023-04-09 15:53:32,438 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-04-09 15:53:32,438 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/cluster_6f150c66-096a-4a5e-360e-e20deca6fb86, deleteOnExit=true 2023-04-09 15:53:32,438 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-04-09 15:53:32,439 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/test.cache.data in system properties and HBase conf 2023-04-09 15:53:32,439 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/hadoop.tmp.dir in system properties and HBase conf 2023-04-09 15:53:32,440 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/hadoop.log.dir in system properties and HBase conf 2023-04-09 15:53:32,440 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/mapreduce.cluster.local.dir in system properties and HBase conf 2023-04-09 15:53:32,441 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-04-09 15:53:32,441 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-04-09 15:53:32,560 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-04-09 15:53:32,988 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-04-09 15:53:32,993 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-04-09 15:53:32,994 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-04-09 15:53:32,994 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-04-09 15:53:32,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-04-09 15:53:32,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-04-09 15:53:32,996 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-04-09 15:53:32,996 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-04-09 15:53:32,997 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/dfs.journalnode.edits.dir in system properties and HBase conf 2023-04-09 15:53:32,997 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-04-09 15:53:32,998 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/nfs.dump.dir in system properties and HBase conf 2023-04-09 15:53:32,998 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/java.io.tmpdir in system properties and HBase conf 2023-04-09 15:53:32,998 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/dfs.journalnode.edits.dir in system properties and HBase conf 2023-04-09 15:53:32,999 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-04-09 15:53:32,999 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-04-09 15:53:33,579 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-04-09 15:53:33,583 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-04-09 15:53:33,873 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-04-09 15:53:34,046 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-04-09 15:53:34,061 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-04-09 15:53:34,111 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-04-09 15:53:34,153 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/java.io.tmpdir/Jetty_localhost_46861_hdfs____.gokaw5/webapp 2023-04-09 15:53:34,325 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46861 2023-04-09 15:53:34,338 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-04-09 15:53:34,338 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-04-09 15:53:34,770 WARN [Listener at localhost/37243] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-04-09 15:53:34,888 WARN [Listener at localhost/37243] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-04-09 15:53:34,928 WARN [Listener at localhost/37243] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-04-09 15:53:34,936 INFO [Listener at localhost/37243] log.Slf4jLog(67): jetty-6.1.26 2023-04-09 15:53:34,946 INFO [Listener at localhost/37243] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/java.io.tmpdir/Jetty_localhost_33755_datanode____2ut34u/webapp 2023-04-09 15:53:35,070 INFO [Listener at localhost/37243] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33755 2023-04-09 15:53:35,502 WARN [Listener at localhost/39283] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-04-09 15:53:36,027 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1ee8cc98a9b71432: Processing first storage report for DS-61cce547-9eac-402f-bf9d-972b5c926f70 from datanode 4cfc1ac7-51a3-4a20-8e9d-d4fea3780500 2023-04-09 15:53:36,028 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1ee8cc98a9b71432: from storage DS-61cce547-9eac-402f-bf9d-972b5c926f70 node DatanodeRegistration(127.0.0.1:33335, datanodeUuid=4cfc1ac7-51a3-4a20-8e9d-d4fea3780500, infoPort=34601, infoSecurePort=0, ipcPort=39283, storageInfo=lv=-57;cid=testClusterID;nsid=2037188697;c=1681055613654), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-04-09 15:53:36,029 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1ee8cc98a9b71432: Processing first storage report for DS-e8583198-42df-4ee7-a8ce-b652ddefb874 from datanode 4cfc1ac7-51a3-4a20-8e9d-d4fea3780500 2023-04-09 15:53:36,029 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1ee8cc98a9b71432: from storage DS-e8583198-42df-4ee7-a8ce-b652ddefb874 node DatanodeRegistration(127.0.0.1:33335, datanodeUuid=4cfc1ac7-51a3-4a20-8e9d-d4fea3780500, infoPort=34601, infoSecurePort=0, ipcPort=39283, storageInfo=lv=-57;cid=testClusterID;nsid=2037188697;c=1681055613654), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-04-09 15:53:36,060 DEBUG [Listener at localhost/39283] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404 2023-04-09 15:53:36,122 INFO [Listener at localhost/39283] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/cluster_6f150c66-096a-4a5e-360e-e20deca6fb86/zookeeper_0, clientPort=64813, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/cluster_6f150c66-096a-4a5e-360e-e20deca6fb86/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/cluster_6f150c66-096a-4a5e-360e-e20deca6fb86/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-04-09 15:53:36,135 INFO [Listener at localhost/39283] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64813 2023-04-09 15:53:36,142 INFO [Listener at localhost/39283] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-04-09 15:53:36,145 INFO [Listener at localhost/39283] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-04-09 15:53:36,816 INFO [Listener at localhost/39283] util.FSUtils(471): Created version file at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9 with version=8 2023-04-09 15:53:36,817 INFO [Listener at localhost/39283] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/hbase-staging 2023-04-09 15:53:37,130 INFO [Listener at localhost/39283] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-04-09 15:53:37,602 INFO [Listener at localhost/39283] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-04-09 15:53:37,636 INFO [Listener at localhost/39283] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-04-09 15:53:37,637 INFO [Listener at localhost/39283] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-04-09 15:53:37,637 INFO [Listener at localhost/39283] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-04-09 15:53:37,637 INFO [Listener at localhost/39283] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-04-09 15:53:37,637 INFO [Listener at localhost/39283] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-04-09 15:53:37,784 INFO [Listener at localhost/39283] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-04-09 15:53:37,857 DEBUG [Listener at localhost/39283] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-04-09 15:53:37,966 INFO [Listener at localhost/39283] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33617 2023-04-09 15:53:37,976 INFO [Listener at localhost/39283] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-04-09 15:53:37,978 INFO [Listener at localhost/39283] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-04-09 15:53:37,998 INFO [Listener at localhost/39283] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33617 connecting to ZooKeeper ensemble=127.0.0.1:64813 2023-04-09 15:53:38,037 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:336170x0, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-04-09 15:53:38,040 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33617-0x10169a0f6310000 connected 2023-04-09 15:53:38,068 DEBUG [Listener at localhost/39283] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-04-09 15:53:38,069 DEBUG [Listener at localhost/39283] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-04-09 15:53:38,074 DEBUG [Listener at localhost/39283] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-04-09 15:53:38,082 DEBUG [Listener at localhost/39283] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33617 2023-04-09 15:53:38,082 DEBUG [Listener at localhost/39283] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33617 2023-04-09 15:53:38,082 DEBUG [Listener at localhost/39283] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33617 2023-04-09 15:53:38,083 DEBUG [Listener at localhost/39283] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33617 2023-04-09 15:53:38,083 DEBUG [Listener at localhost/39283] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33617 2023-04-09 15:53:38,091 INFO [Listener at localhost/39283] master.HMaster(444): hbase.rootdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9, hbase.cluster.distributed=false 2023-04-09 15:53:38,168 INFO [Listener at localhost/39283] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-04-09 15:53:38,168 INFO [Listener at localhost/39283] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-04-09 15:53:38,169 INFO [Listener at localhost/39283] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-04-09 15:53:38,169 INFO [Listener at localhost/39283] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-04-09 15:53:38,169 INFO [Listener at localhost/39283] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-04-09 15:53:38,169 INFO [Listener at localhost/39283] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-04-09 15:53:38,175 INFO [Listener at localhost/39283] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-04-09 15:53:38,178 INFO [Listener at localhost/39283] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44869 2023-04-09 15:53:38,180 INFO [Listener at localhost/39283] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-04-09 15:53:38,186 DEBUG [Listener at localhost/39283] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-04-09 15:53:38,188 INFO [Listener at localhost/39283] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-04-09 15:53:38,191 INFO [Listener at localhost/39283] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-04-09 15:53:38,193 INFO [Listener at localhost/39283] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44869 connecting to ZooKeeper ensemble=127.0.0.1:64813 2023-04-09 15:53:38,196 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:448690x0, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-04-09 15:53:38,197 DEBUG [Listener at localhost/39283] zookeeper.ZKUtil(164): regionserver:448690x0, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-04-09 15:53:38,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44869-0x10169a0f6310001 connected 2023-04-09 15:53:38,200 DEBUG [Listener at localhost/39283] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-04-09 15:53:38,201 DEBUG [Listener at localhost/39283] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-04-09 15:53:38,202 DEBUG [Listener at localhost/39283] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44869 2023-04-09 15:53:38,203 DEBUG [Listener at localhost/39283] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44869 2023-04-09 15:53:38,203 DEBUG [Listener at localhost/39283] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44869 2023-04-09 15:53:38,204 DEBUG [Listener at localhost/39283] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44869 2023-04-09 15:53:38,208 DEBUG [Listener at localhost/39283] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44869 2023-04-09 15:53:38,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33617,1681055616968 2023-04-09 15:53:38,222 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-04-09 15:53:38,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33617,1681055616968 2023-04-09 15:53:38,243 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-04-09 15:53:38,243 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-04-09 15:53:38,243 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-09 15:53:38,244 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-04-09 15:53:38,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33617,1681055616968 from backup master directory 2023-04-09 15:53:38,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-04-09 15:53:38,249 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33617,1681055616968 2023-04-09 15:53:38,249 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-04-09 15:53:38,250 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-04-09 15:53:38,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33617,1681055616968 2023-04-09 15:53:38,253 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-04-09 15:53:38,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-04-09 15:53:38,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/hbase.id with ID: faae79c0-a05e-45ad-bc79-9fc42c4003de 2023-04-09 15:53:38,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-04-09 15:53:38,803 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-09 15:53:38,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2b1dc256 to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:53:38,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6159a3d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:53:38,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-04-09 15:53:38,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-04-09 15:53:38,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-04-09 15:53:38,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-04-09 15:53:38,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-04-09 15:53:38,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-04-09 15:53:38,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-04-09 15:53:38,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/MasterData/data/master/store-tmp 2023-04-09 15:53:39,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:53:39,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-04-09 15:53:39,003 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-04-09 15:53:39,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-04-09 15:53:39,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-04-09 15:53:39,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-04-09 15:53:39,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-04-09 15:53:39,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-04-09 15:53:39,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/MasterData/WALs/jenkins-hbase4.apache.org,33617,1681055616968 2023-04-09 15:53:39,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33617%2C1681055616968, suffix=, logDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/MasterData/WALs/jenkins-hbase4.apache.org,33617,1681055616968, archiveDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/MasterData/oldWALs, maxLogs=10 2023-04-09 15:53:39,092 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33335,DS-61cce547-9eac-402f-bf9d-972b5c926f70,DISK] 2023-04-09 15:53:39,101 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-04-09 15:53:39,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/MasterData/WALs/jenkins-hbase4.apache.org,33617,1681055616968/jenkins-hbase4.apache.org%2C33617%2C1681055616968.1681055619039 2023-04-09 15:53:39,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33335,DS-61cce547-9eac-402f-bf9d-972b5c926f70,DISK]] 2023-04-09 15:53:39,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-04-09 15:53:39,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:53:39,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-04-09 15:53:39,175 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-04-09 15:53:39,236 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-04-09 15:53:39,243 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-04-09 15:53:39,275 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-04-09 15:53:39,288 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:53:39,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-04-09 15:53:39,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-04-09 15:53:39,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-04-09 15:53:39,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:53:39,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70589860, jitterRate=0.051870882511138916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-09 15:53:39,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-04-09 15:53:39,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-04-09 15:53:39,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-04-09 15:53:39,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-04-09 15:53:39,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-04-09 15:53:39,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-04-09 15:53:39,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 38 msec 2023-04-09 15:53:39,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-04-09 15:53:39,421 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-04-09 15:53:39,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-04-09 15:53:39,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-04-09 15:53:39,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-04-09 15:53:39,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-04-09 15:53:39,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-04-09 15:53:39,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-04-09 15:53:39,470 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-09 15:53:39,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-04-09 15:53:39,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-04-09 15:53:39,486 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-04-09 15:53:39,491 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-04-09 15:53:39,491 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-04-09 15:53:39,491 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-09 15:53:39,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33617,1681055616968, sessionid=0x10169a0f6310000, setting cluster-up flag (Was=false) 2023-04-09 15:53:39,507 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-09 15:53:39,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-04-09 15:53:39,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33617,1681055616968 2023-04-09 15:53:39,519 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-09 15:53:39,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-04-09 15:53:39,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33617,1681055616968 2023-04-09 15:53:39,529 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.hbase-snapshot/.tmp 2023-04-09 15:53:39,613 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(952): ClusterId : faae79c0-a05e-45ad-bc79-9fc42c4003de 2023-04-09 15:53:39,617 DEBUG [RS:0;jenkins-hbase4:44869] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-04-09 15:53:39,622 DEBUG [RS:0;jenkins-hbase4:44869] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-04-09 15:53:39,622 DEBUG [RS:0;jenkins-hbase4:44869] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-04-09 15:53:39,627 DEBUG [RS:0;jenkins-hbase4:44869] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-04-09 15:53:39,628 DEBUG [RS:0;jenkins-hbase4:44869] zookeeper.ReadOnlyZKClient(139): Connect 0x56148b3d to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:53:39,633 DEBUG [RS:0;jenkins-hbase4:44869] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58d36f8f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:53:39,635 DEBUG [RS:0;jenkins-hbase4:44869] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cece04d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-04-09 15:53:39,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-04-09 15:53:39,660 DEBUG [RS:0;jenkins-hbase4:44869] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44869 2023-04-09 15:53:39,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-04-09 15:53:39,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-04-09 15:53:39,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-04-09 15:53:39,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-04-09 15:53:39,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-04-09 15:53:39,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-04-09 15:53:39,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-04-09 15:53:39,663 INFO [RS:0;jenkins-hbase4:44869] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-04-09 15:53:39,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-04-09 15:53:39,663 INFO [RS:0;jenkins-hbase4:44869] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-04-09 15:53:39,663 DEBUG [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(1023): About to register with Master. 2023-04-09 15:53:39,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1681055649665 2023-04-09 15:53:39,667 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33617,1681055616968 with isa=jenkins-hbase4.apache.org/172.31.14.131:44869, startcode=1681055618167 2023-04-09 15:53:39,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-04-09 15:53:39,672 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-04-09 15:53:39,672 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-04-09 15:53:39,677 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-04-09 15:53:39,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-04-09 15:53:39,690 DEBUG [RS:0;jenkins-hbase4:44869] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-04-09 15:53:39,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-04-09 15:53:39,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-04-09 15:53:39,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-04-09 15:53:39,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-04-09 15:53:39,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-04-09 15:53:39,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-04-09 15:53:39,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-04-09 15:53:39,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-04-09 15:53:39,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-04-09 15:53:39,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-04-09 15:53:39,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1681055619704,5,FailOnTimeoutGroup] 2023-04-09 15:53:39,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1681055619706,5,FailOnTimeoutGroup] 2023-04-09 15:53:39,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-04-09 15:53:39,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-04-09 15:53:39,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-04-09 15:53:39,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-04-09 15:53:39,742 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42585, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-04-09 15:53:39,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:39,768 DEBUG [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9 2023-04-09 15:53:39,769 DEBUG [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37243 2023-04-09 15:53:39,769 DEBUG [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-04-09 15:53:39,774 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-04-09 15:53:39,774 DEBUG [RS:0;jenkins-hbase4:44869] zookeeper.ZKUtil(162): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:39,775 WARN [RS:0;jenkins-hbase4:44869] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-04-09 15:53:39,775 INFO [RS:0;jenkins-hbase4:44869] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-04-09 15:53:39,776 DEBUG [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/WALs/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:39,777 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44869,1681055618167] 2023-04-09 15:53:39,785 DEBUG [RS:0;jenkins-hbase4:44869] zookeeper.ZKUtil(162): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:39,796 DEBUG [RS:0;jenkins-hbase4:44869] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-04-09 15:53:39,806 INFO [RS:0;jenkins-hbase4:44869] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-04-09 15:53:39,824 INFO [RS:0;jenkins-hbase4:44869] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-04-09 15:53:39,827 INFO [RS:0;jenkins-hbase4:44869] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:53:39,827 INFO [RS:0;jenkins-hbase4:44869] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:53:39,828 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-04-09 15:53:39,835 INFO [RS:0;jenkins-hbase4:44869] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-04-09 15:53:39,836 DEBUG [RS:0;jenkins-hbase4:44869] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-04-09 15:53:39,836 DEBUG [RS:0;jenkins-hbase4:44869] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-04-09 15:53:39,836 DEBUG [RS:0;jenkins-hbase4:44869] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-04-09 15:53:39,836 DEBUG [RS:0;jenkins-hbase4:44869] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-04-09 15:53:39,836 DEBUG [RS:0;jenkins-hbase4:44869] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-04-09 15:53:39,836 DEBUG [RS:0;jenkins-hbase4:44869] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-04-09 15:53:39,837 DEBUG [RS:0;jenkins-hbase4:44869] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-04-09 15:53:39,837 DEBUG [RS:0;jenkins-hbase4:44869] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-04-09 15:53:39,837 DEBUG [RS:0;jenkins-hbase4:44869] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-04-09 15:53:39,837 DEBUG [RS:0;jenkins-hbase4:44869] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-04-09 15:53:39,838 INFO [RS:0;jenkins-hbase4:44869] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-04-09 15:53:39,838 INFO [RS:0;jenkins-hbase4:44869] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-04-09 15:53:39,838 INFO [RS:0;jenkins-hbase4:44869] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-04-09 15:53:39,854 INFO [RS:0;jenkins-hbase4:44869] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-04-09 15:53:39,856 INFO [RS:0;jenkins-hbase4:44869] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44869,1681055618167-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:53:39,871 INFO [RS:0;jenkins-hbase4:44869] regionserver.Replication(203): jenkins-hbase4.apache.org,44869,1681055618167 started 2023-04-09 15:53:39,872 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44869,1681055618167, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44869, sessionid=0x10169a0f6310001 2023-04-09 15:53:39,872 DEBUG [RS:0;jenkins-hbase4:44869] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-04-09 15:53:39,872 DEBUG [RS:0;jenkins-hbase4:44869] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:39,872 DEBUG [RS:0;jenkins-hbase4:44869] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44869,1681055618167' 2023-04-09 15:53:39,872 DEBUG [RS:0;jenkins-hbase4:44869] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:39,873 DEBUG [RS:0;jenkins-hbase4:44869] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:39,873 DEBUG [RS:0;jenkins-hbase4:44869] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-04-09 15:53:39,873 DEBUG [RS:0;jenkins-hbase4:44869] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-04-09 15:53:39,874 DEBUG [RS:0;jenkins-hbase4:44869] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:39,874 DEBUG [RS:0;jenkins-hbase4:44869] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44869,1681055618167' 2023-04-09 15:53:39,874 DEBUG [RS:0;jenkins-hbase4:44869] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-04-09 15:53:39,874 DEBUG [RS:0;jenkins-hbase4:44869] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-04-09 15:53:39,874 DEBUG [RS:0;jenkins-hbase4:44869] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-04-09 15:53:39,875 INFO [RS:0;jenkins-hbase4:44869] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-04-09 15:53:39,875 INFO [RS:0;jenkins-hbase4:44869] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-04-09 15:53:39,986 INFO [RS:0;jenkins-hbase4:44869] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44869%2C1681055618167, suffix=, logDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/WALs/jenkins-hbase4.apache.org,44869,1681055618167, archiveDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/oldWALs, maxLogs=32 2023-04-09 15:53:40,004 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33335,DS-61cce547-9eac-402f-bf9d-972b5c926f70,DISK] 2023-04-09 15:53:40,007 INFO [RS:0;jenkins-hbase4:44869] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/WALs/jenkins-hbase4.apache.org,44869,1681055618167/jenkins-hbase4.apache.org%2C44869%2C1681055618167.1681055619988 2023-04-09 15:53:40,008 DEBUG [RS:0;jenkins-hbase4:44869] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33335,DS-61cce547-9eac-402f-bf9d-972b5c926f70,DISK]] 2023-04-09 15:53:40,111 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-04-09 15:53:40,112 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-04-09 15:53:40,112 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9 2023-04-09 15:53:40,125 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:53:40,127 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-04-09 15:53:40,130 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/info 2023-04-09 15:53:40,131 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-04-09 15:53:40,132 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:53:40,132 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-04-09 15:53:40,135 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/rep_barrier 2023-04-09 15:53:40,135 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-04-09 15:53:40,136 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:53:40,136 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-04-09 15:53:40,138 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/table 2023-04-09 15:53:40,139 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-04-09 15:53:40,139 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:53:40,141 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740 2023-04-09 15:53:40,142 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740 2023-04-09 15:53:40,145 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-04-09 15:53:40,147 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-04-09 15:53:40,150 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:53:40,151 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64624457, jitterRate=-0.037020549178123474}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-04-09 15:53:40,151 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-04-09 15:53:40,151 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-04-09 15:53:40,151 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-04-09 15:53:40,151 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-04-09 15:53:40,151 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-04-09 15:53:40,151 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-04-09 15:53:40,152 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-04-09 15:53:40,152 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-04-09 15:53:40,157 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-04-09 15:53:40,157 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-04-09 15:53:40,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-04-09 15:53:40,175 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-04-09 15:53:40,177 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-04-09 15:53:40,329 DEBUG [jenkins-hbase4:33617] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-04-09 15:53:40,332 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44869,1681055618167, state=OPENING 2023-04-09 15:53:40,341 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-04-09 15:53:40,343 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-09 15:53:40,344 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-04-09 15:53:40,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:53:40,531 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:40,534 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-04-09 15:53:40,537 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-04-09 15:53:40,549 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-04-09 15:53:40,549 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-04-09 15:53:40,552 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44869%2C1681055618167.meta, suffix=.meta, logDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/WALs/jenkins-hbase4.apache.org,44869,1681055618167, archiveDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/oldWALs, maxLogs=32 2023-04-09 15:53:40,568 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33335,DS-61cce547-9eac-402f-bf9d-972b5c926f70,DISK] 2023-04-09 15:53:40,572 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/WALs/jenkins-hbase4.apache.org,44869,1681055618167/jenkins-hbase4.apache.org%2C44869%2C1681055618167.meta.1681055620553.meta 2023-04-09 15:53:40,572 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33335,DS-61cce547-9eac-402f-bf9d-972b5c926f70,DISK]] 2023-04-09 15:53:40,573 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-04-09 15:53:40,574 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-04-09 15:53:40,590 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-04-09 15:53:40,596 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-04-09 15:53:40,602 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-04-09 15:53:40,602 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:53:40,602 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-04-09 15:53:40,602 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-04-09 15:53:40,605 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-04-09 15:53:40,607 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/info 2023-04-09 15:53:40,607 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/info 2023-04-09 15:53:40,608 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-04-09 15:53:40,609 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:53:40,609 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-04-09 15:53:40,611 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/rep_barrier 2023-04-09 15:53:40,611 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/rep_barrier 2023-04-09 15:53:40,612 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-04-09 15:53:40,613 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:53:40,613 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-04-09 15:53:40,614 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/table 2023-04-09 15:53:40,614 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/table 2023-04-09 15:53:40,615 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-04-09 15:53:40,616 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:53:40,618 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740 2023-04-09 15:53:40,621 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740 2023-04-09 15:53:40,625 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-04-09 15:53:40,629 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-04-09 15:53:40,630 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65418765, jitterRate=-0.02518443763256073}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-04-09 15:53:40,630 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-04-09 15:53:40,643 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1681055620524 2023-04-09 15:53:40,662 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-04-09 15:53:40,663 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-04-09 15:53:40,664 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44869,1681055618167, state=OPEN 2023-04-09 15:53:40,666 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-04-09 15:53:40,667 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-04-09 15:53:40,671 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-04-09 15:53:40,671 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44869,1681055618167 in 321 msec 2023-04-09 15:53:40,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-04-09 15:53:40,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 508 msec 2023-04-09 15:53:40,681 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1080 sec 2023-04-09 15:53:40,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1681055620681, completionTime=-1 2023-04-09 15:53:40,682 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-04-09 15:53:40,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-04-09 15:53:40,747 DEBUG [hconnection-0x6b42ca1a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:53:40,752 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:53:40,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-04-09 15:53:40,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1681055680773 2023-04-09 15:53:40,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1681055740773 2023-04-09 15:53:40,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 90 msec 2023-04-09 15:53:40,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33617,1681055616968-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:53:40,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33617,1681055616968-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-04-09 15:53:40,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33617,1681055616968-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-04-09 15:53:40,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33617, period=300000, unit=MILLISECONDS is enabled. 2023-04-09 15:53:40,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-04-09 15:53:40,804 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-04-09 15:53:40,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-04-09 15:53:40,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-04-09 15:53:40,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-04-09 15:53:40,824 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-04-09 15:53:40,827 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-09 15:53:40,847 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/hbase/namespace/badd1d2631fbe3578448b9259f8df02d 2023-04-09 15:53:40,850 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/hbase/namespace/badd1d2631fbe3578448b9259f8df02d empty. 2023-04-09 15:53:40,851 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/hbase/namespace/badd1d2631fbe3578448b9259f8df02d 2023-04-09 15:53:40,851 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-04-09 15:53:41,280 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-04-09 15:53:41,282 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => badd1d2631fbe3578448b9259f8df02d, NAME => 'hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:53:41,697 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:53:41,697 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing badd1d2631fbe3578448b9259f8df02d, disabling compactions & flushes 2023-04-09 15:53:41,697 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d. 2023-04-09 15:53:41,697 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d. 2023-04-09 15:53:41,697 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d. after waiting 0 ms 2023-04-09 15:53:41,698 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d. 2023-04-09 15:53:41,698 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d. 2023-04-09 15:53:41,698 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for badd1d2631fbe3578448b9259f8df02d: 2023-04-09 15:53:41,703 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-04-09 15:53:41,718 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1681055621706"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055621706"}]},"ts":"1681055621706"} 2023-04-09 15:53:41,747 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-04-09 15:53:41,748 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-09 15:53:41,753 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055621749"}]},"ts":"1681055621749"} 2023-04-09 15:53:41,757 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-04-09 15:53:41,766 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=badd1d2631fbe3578448b9259f8df02d, ASSIGN}] 2023-04-09 15:53:41,768 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=badd1d2631fbe3578448b9259f8df02d, ASSIGN 2023-04-09 15:53:41,770 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=badd1d2631fbe3578448b9259f8df02d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:53:41,921 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=badd1d2631fbe3578448b9259f8df02d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:41,921 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1681055621920"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055621920"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055621920"}]},"ts":"1681055621920"} 2023-04-09 15:53:41,925 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure badd1d2631fbe3578448b9259f8df02d, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:53:42,086 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d. 2023-04-09 15:53:42,086 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => badd1d2631fbe3578448b9259f8df02d, NAME => 'hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d.', STARTKEY => '', ENDKEY => ''} 2023-04-09 15:53:42,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace badd1d2631fbe3578448b9259f8df02d 2023-04-09 15:53:42,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:53:42,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for badd1d2631fbe3578448b9259f8df02d 2023-04-09 15:53:42,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for badd1d2631fbe3578448b9259f8df02d 2023-04-09 15:53:42,090 INFO [StoreOpener-badd1d2631fbe3578448b9259f8df02d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region badd1d2631fbe3578448b9259f8df02d 2023-04-09 15:53:42,092 DEBUG [StoreOpener-badd1d2631fbe3578448b9259f8df02d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/namespace/badd1d2631fbe3578448b9259f8df02d/info 2023-04-09 15:53:42,092 DEBUG [StoreOpener-badd1d2631fbe3578448b9259f8df02d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/namespace/badd1d2631fbe3578448b9259f8df02d/info 2023-04-09 15:53:42,093 INFO [StoreOpener-badd1d2631fbe3578448b9259f8df02d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region badd1d2631fbe3578448b9259f8df02d columnFamilyName info 2023-04-09 15:53:42,094 INFO [StoreOpener-badd1d2631fbe3578448b9259f8df02d-1] regionserver.HStore(310): Store=badd1d2631fbe3578448b9259f8df02d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:53:42,095 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/namespace/badd1d2631fbe3578448b9259f8df02d 2023-04-09 15:53:42,096 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/namespace/badd1d2631fbe3578448b9259f8df02d 2023-04-09 15:53:42,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for badd1d2631fbe3578448b9259f8df02d 2023-04-09 15:53:42,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/namespace/badd1d2631fbe3578448b9259f8df02d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:53:42,105 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened badd1d2631fbe3578448b9259f8df02d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66010908, jitterRate=-0.016360819339752197}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-09 15:53:42,105 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for badd1d2631fbe3578448b9259f8df02d: 2023-04-09 15:53:42,107 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d., pid=6, masterSystemTime=1681055622079 2023-04-09 15:53:42,111 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d. 2023-04-09 15:53:42,111 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d. 2023-04-09 15:53:42,113 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=badd1d2631fbe3578448b9259f8df02d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:42,113 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1681055622112"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055622112"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055622112"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055622112"}]},"ts":"1681055622112"} 2023-04-09 15:53:42,121 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-04-09 15:53:42,121 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure badd1d2631fbe3578448b9259f8df02d, server=jenkins-hbase4.apache.org,44869,1681055618167 in 192 msec 2023-04-09 15:53:42,124 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-04-09 15:53:42,124 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=badd1d2631fbe3578448b9259f8df02d, ASSIGN in 355 msec 2023-04-09 15:53:42,125 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-09 15:53:42,126 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055622125"}]},"ts":"1681055622125"} 2023-04-09 15:53:42,128 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-04-09 15:53:42,131 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-04-09 15:53:42,134 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3170 sec 2023-04-09 15:53:42,226 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-04-09 15:53:42,227 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-04-09 15:53:42,227 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-09 15:53:42,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-04-09 15:53:42,296 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-04-09 15:53:42,305 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 46 msec 2023-04-09 15:53:42,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-04-09 15:53:42,326 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-04-09 15:53:42,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-04-09 15:53:42,339 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-04-09 15:53:42,341 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-04-09 15:53:42,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.091sec 2023-04-09 15:53:42,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-04-09 15:53:42,345 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-04-09 15:53:42,345 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-04-09 15:53:42,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33617,1681055616968-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-04-09 15:53:42,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33617,1681055616968-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-04-09 15:53:42,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-04-09 15:53:42,419 DEBUG [Listener at localhost/39283] zookeeper.ReadOnlyZKClient(139): Connect 0x0629018b to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:53:42,425 DEBUG [Listener at localhost/39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c1e7f16, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:53:42,439 DEBUG [hconnection-0x77bc4ff1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:53:42,451 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:53:42,463 INFO [Listener at localhost/39283] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33617,1681055616968 2023-04-09 15:53:42,464 DEBUG [Listener at localhost/39283] zookeeper.ReadOnlyZKClient(139): Connect 0x7defec53 to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:53:42,472 DEBUG [Listener at localhost/39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64b944ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:53:42,472 INFO [Listener at localhost/39283] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-04-09 15:53:42,496 INFO [Listener at localhost/39283] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=211, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=169, AvailableMemoryMB=2446 2023-04-09 15:53:42,507 DEBUG [Listener at localhost/39283] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-09 15:53:42,511 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47456, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-09 15:53:42,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-04-09 15:53:42,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:42,530 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-04-09 15:53:42,533 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-09 15:53:42,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-04-09 15:53:42,537 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:53:42,539 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137 empty. 2023-04-09 15:53:42,541 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:53:42,541 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-04-09 15:53:42,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-04-09 15:53:42,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-04-09 15:53:42,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-04-09 15:53:42,961 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-04-09 15:53:42,964 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => c2e5a80bc0a57b639d176e9f52480137, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:53:42,977 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:53:42,977 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing c2e5a80bc0a57b639d176e9f52480137, disabling compactions & flushes 2023-04-09 15:53:42,977 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:42,977 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:42,977 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. after waiting 0 ms 2023-04-09 15:53:42,977 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:42,978 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:42,978 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:42,982 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-04-09 15:53:42,984 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1681055622984"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055622984"}]},"ts":"1681055622984"} 2023-04-09 15:53:42,987 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-04-09 15:53:42,988 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-09 15:53:42,988 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055622988"}]},"ts":"1681055622988"} 2023-04-09 15:53:42,990 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-04-09 15:53:42,995 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c2e5a80bc0a57b639d176e9f52480137, ASSIGN}] 2023-04-09 15:53:42,997 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c2e5a80bc0a57b639d176e9f52480137, ASSIGN 2023-04-09 15:53:42,999 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c2e5a80bc0a57b639d176e9f52480137, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:53:43,150 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c2e5a80bc0a57b639d176e9f52480137, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:43,150 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1681055623150"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055623150"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055623150"}]},"ts":"1681055623150"} 2023-04-09 15:53:43,153 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure c2e5a80bc0a57b639d176e9f52480137, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:53:43,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-04-09 15:53:43,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:43,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c2e5a80bc0a57b639d176e9f52480137, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137.', STARTKEY => '', ENDKEY => ''} 2023-04-09 15:53:43,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:53:43,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:53:43,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:53:43,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:53:43,318 INFO [StoreOpener-c2e5a80bc0a57b639d176e9f52480137-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:53:43,320 DEBUG [StoreOpener-c2e5a80bc0a57b639d176e9f52480137-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1 2023-04-09 15:53:43,320 DEBUG [StoreOpener-c2e5a80bc0a57b639d176e9f52480137-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1 2023-04-09 15:53:43,323 INFO [StoreOpener-c2e5a80bc0a57b639d176e9f52480137-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2e5a80bc0a57b639d176e9f52480137 columnFamilyName family1 2023-04-09 15:53:43,326 INFO [StoreOpener-c2e5a80bc0a57b639d176e9f52480137-1] regionserver.HStore(310): Store=c2e5a80bc0a57b639d176e9f52480137/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:53:43,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:53:43,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:53:43,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:53:43,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:53:43,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c2e5a80bc0a57b639d176e9f52480137; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72917448, jitterRate=0.0865546464920044}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-09 15:53:43,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:43,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137., pid=11, masterSystemTime=1681055623306 2023-04-09 15:53:43,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:43,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:43,343 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c2e5a80bc0a57b639d176e9f52480137, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:43,343 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1681055623343"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055623343"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055623343"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055623343"}]},"ts":"1681055623343"} 2023-04-09 15:53:43,350 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-04-09 15:53:43,350 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure c2e5a80bc0a57b639d176e9f52480137, server=jenkins-hbase4.apache.org,44869,1681055618167 in 193 msec 2023-04-09 15:53:43,353 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-04-09 15:53:43,353 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c2e5a80bc0a57b639d176e9f52480137, ASSIGN in 355 msec 2023-04-09 15:53:43,354 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-09 15:53:43,355 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055623355"}]},"ts":"1681055623355"} 2023-04-09 15:53:43,357 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-04-09 15:53:43,360 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-04-09 15:53:43,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 835 msec 2023-04-09 15:53:43,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-04-09 15:53:43,660 INFO [Listener at localhost/39283] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-04-09 15:53:43,682 DEBUG [hconnection-0x611a5737-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:53:43,685 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:53:43,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:43,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:43,876 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:43,877 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:43,877 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-09 15:53:43,877 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-09 15:53:43,878 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:43,878 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:43,879 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:43,879 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:43,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:43,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:43,880 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:43,880 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:43,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:43,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:43,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:43,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:43,881 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:43,883 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:43,883 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-09 15:53:43,884 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:43,884 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-09 15:53:43,885 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:43,885 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:43,885 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:43,886 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. started... 2023-04-09 15:53:43,886 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c2e5a80bc0a57b639d176e9f52480137 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-04-09 15:53:44,422 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511300ffa0fafce074eb0ab144673a8cbe55a to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511300ffa0fafce074eb0ab144673a8cbe55a 2023-04-09 15:53:44,838 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/d790845739ae42c3b6fe55dd5ec619b1 2023-04-09 15:53:44,854 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/d790845739ae42c3b6fe55dd5ec619b1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/d790845739ae42c3b6fe55dd5ec619b1 2023-04-09 15:53:44,874 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/d790845739ae42c3b6fe55dd5ec619b1, entries=1000, sequenceid=5, filesize=175.8 K 2023-04-09 15:53:44,878 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for c2e5a80bc0a57b639d176e9f52480137 in 991ms, sequenceid=5, compaction requested=false 2023-04-09 15:53:44,880 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:44,883 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:44,884 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:44,884 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:44,884 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:44,884 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:44,885 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-09 15:53:44,885 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-09 15:53:44,888 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,889 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:44,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:44,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:44,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:44,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:44,890 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,890 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:44,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:44,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:44,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:44,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-09 15:53:44,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e7e5b58[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:44,894 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-09 15:53:44,894 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,904 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,905 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-09 15:53:44,905 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-09 15:53:44,905 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:44,905 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:44,905 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:44,908 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:44,909 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-09 15:53:44,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:44,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:44,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:44,909 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:44,909 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-09 15:53:44,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:44,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:44,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:44,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:44,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:44,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:44,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-09 15:53:44,915 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-09 15:53:44,915 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:44,915 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:44,915 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,915 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:44,922 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,922 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,922 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:44,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:44,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:44,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:44,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:44,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:44,924 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:44,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:44,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,926 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:44,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:44,937 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:44,937 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:44,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:44,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:44,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:44,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:44,939 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:44,939 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,939 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,939 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:44,939 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,939 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,939 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:44,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-04-09 15:53:44,939 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:44,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:44,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:44,945 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:44,945 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:45,045 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:45,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:45,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:45,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-04-09 15:53:45,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,080 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:45,080 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:45,084 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-09 15:53:45,084 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-09 15:53:45,085 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,085 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,087 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,087 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,088 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:45,088 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:45,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:45,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:45,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:45,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,090 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,091 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-04-09 15:53:45,091 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-09 15:53:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:45,092 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-09 15:53:45,092 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:45,092 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:45,093 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:45,093 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. started... 2023-04-09 15:53:45,093 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c2e5a80bc0a57b639d176e9f52480137 1/1 column families, dataSize=74 B heapSize=408 B 2023-04-09 15:53:45,551 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128413d562fac064111bcca78fe5bbec047 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128413d562fac064111bcca78fe5bbec047 2023-04-09 15:53:45,577 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/aecbb9c6375f47fc96208c3ff06c8428 2023-04-09 15:53:45,590 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/aecbb9c6375f47fc96208c3ff06c8428 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/aecbb9c6375f47fc96208c3ff06c8428 2023-04-09 15:53:45,600 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/aecbb9c6375f47fc96208c3ff06c8428, entries=1, sequenceid=9, filesize=5.0 K 2023-04-09 15:53:45,601 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for c2e5a80bc0a57b639d176e9f52480137 in 508ms, sequenceid=9, compaction requested=false 2023-04-09 15:53:45,602 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:45,602 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:45,602 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:45,602 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:45,602 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,602 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-09 15:53:45,602 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-09 15:53:45,605 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,606 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,606 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:45,611 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:45,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:45,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:45,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:45,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:45,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-09 15:53:45,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c37e25c[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:45,623 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-09 15:53:45,623 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,625 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,625 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-09 15:53:45,625 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-09 15:53:45,625 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:45,625 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,625 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:45,629 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-09 15:53:45,629 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,629 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:45,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:45,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:45,629 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-09 15:53:45,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:45,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:45,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:45,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:45,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-09 15:53:45,636 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-09 15:53:45,636 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:45,636 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:45,636 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,636 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:45,645 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,645 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:45,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:45,645 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:45,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:45,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:45,647 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:45,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,651 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:45,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,657 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:45,657 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,657 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:45,657 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,657 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,657 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:45,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-04-09 15:53:45,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:45,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:45,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:45,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:45,657 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,658 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,658 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,658 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:45,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:45,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:45,658 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:45,658 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,759 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:45,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:45,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:45,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-04-09 15:53:45,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,783 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:45,784 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:45,784 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-09 15:53:45,784 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-09 15:53:45,785 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,785 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,786 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,786 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:45,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:45,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:45,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,790 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,790 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:45,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:45,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,791 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,796 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-04-09 15:53:45,796 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,796 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-09 15:53:45,796 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:45,807 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-09 15:53:45,816 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:45,816 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:45,816 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:45,816 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. started... 2023-04-09 15:53:45,816 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c2e5a80bc0a57b639d176e9f52480137 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:53:45,873 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201233da41d10b14249adf225602ba6cedd to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201233da41d10b14249adf225602ba6cedd 2023-04-09 15:53:45,915 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/747960a2adff4aba885b421dd5143979 2023-04-09 15:53:45,929 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/747960a2adff4aba885b421dd5143979 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/747960a2adff4aba885b421dd5143979 2023-04-09 15:53:45,938 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/747960a2adff4aba885b421dd5143979, entries=1, sequenceid=13, filesize=5.0 K 2023-04-09 15:53:45,940 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c2e5a80bc0a57b639d176e9f52480137 in 124ms, sequenceid=13, compaction requested=true 2023-04-09 15:53:45,941 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:45,941 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:45,941 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:45,942 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:45,942 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,942 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-09 15:53:45,942 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-09 15:53:45,947 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,947 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:45,947 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:45,947 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:45,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:45,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:45,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-09 15:53:45,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36634978[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:45,953 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-09 15:53:45,953 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,955 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,955 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-09 15:53:45,955 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-09 15:53:45,955 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,956 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:45,955 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:45,958 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-09 15:53:45,958 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:45,958 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,958 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-09 15:53:45,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:45,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:45,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:45,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:45,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:45,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:45,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-09 15:53:45,965 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-09 15:53:45,965 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:45,965 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:45,965 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,965 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:45,968 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,968 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,968 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:45,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:45,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:45,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:45,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:45,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:45,973 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:45,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,978 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,991 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:45,992 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:45,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:45,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:45,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:45,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:45,993 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,993 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,993 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,993 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:45,993 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:45,993 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,993 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:45,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:45,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:45,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-04-09 15:53:45,995 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:45,995 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:45,993 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,095 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:46,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:46,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:46,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-04-09 15:53:46,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,135 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:46,135 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:46,136 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-09 15:53:46,136 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-09 15:53:46,136 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,137 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,138 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,139 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:46,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:46,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:46,139 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,139 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:46,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:46,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,141 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,141 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-04-09 15:53:46,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,142 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-09 15:53:46,142 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:46,142 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-09 15:53:46,144 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:46,144 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:46,144 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:46,144 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. started... 2023-04-09 15:53:46,144 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c2e5a80bc0a57b639d176e9f52480137 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:53:46,148 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-09 15:53:46,281 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-04-09 15:53:46,283 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-04-09 15:53:46,666 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d3a0f8ae31a34b53af15cec2be091eaf to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205d3a0f8ae31a34b53af15cec2be091eaf 2023-04-09 15:53:46,695 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/9bdcbdfc5a4e42c0bee1da8d69980af4 2023-04-09 15:53:46,707 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/9bdcbdfc5a4e42c0bee1da8d69980af4 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/9bdcbdfc5a4e42c0bee1da8d69980af4 2023-04-09 15:53:46,719 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/9bdcbdfc5a4e42c0bee1da8d69980af4, entries=1, sequenceid=17, filesize=5.0 K 2023-04-09 15:53:46,721 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c2e5a80bc0a57b639d176e9f52480137 in 577ms, sequenceid=17, compaction requested=true 2023-04-09 15:53:46,722 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:46,722 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:46,722 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:46,722 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:46,722 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,722 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-09 15:53:46,722 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-09 15:53:46,725 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,725 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:46,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:46,726 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,726 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:46,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:46,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:46,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:46,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-09 15:53:46,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e074a77[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:46,730 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-09 15:53:46,730 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,731 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,731 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-09 15:53:46,732 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-09 15:53:46,732 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:46,732 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,732 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:46,735 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-09 15:53:46,735 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:46,735 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-09 15:53:46,735 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:46,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:46,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:46,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:46,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:46,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:46,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-09 15:53:46,741 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-09 15:53:46,741 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:46,741 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:46,741 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,741 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:46,748 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,748 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:46,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:46,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:46,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,750 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:46,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:46,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:46,752 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:46,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,757 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:46,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,768 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,768 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,768 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:46,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:46,768 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,768 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,768 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,768 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:46,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-04-09 15:53:46,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:46,768 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:46,768 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:46,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:46,769 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:46,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:46,770 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:46,770 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:46,871 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:46,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:46,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:46,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-04-09 15:53:46,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,896 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:46,896 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:46,897 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-09 15:53:46,897 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-09 15:53:46,898 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,898 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,900 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,900 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:46,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:46,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:46,902 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:46,902 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:46,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:46,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,903 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,905 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-04-09 15:53:46,905 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:46,905 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-09 15:53:46,905 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:46,905 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-09 15:53:46,906 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:46,906 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:46,906 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:46,906 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. started... 2023-04-09 15:53:46,906 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c2e5a80bc0a57b639d176e9f52480137 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:53:46,973 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285b95ac88515e4aaba6ae186e398e4fe6 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512285b95ac88515e4aaba6ae186e398e4fe6 2023-04-09 15:53:46,992 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/fc764212fd09418ca116887e3cd530e2 2023-04-09 15:53:47,001 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/fc764212fd09418ca116887e3cd530e2 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/fc764212fd09418ca116887e3cd530e2 2023-04-09 15:53:47,011 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/fc764212fd09418ca116887e3cd530e2, entries=1, sequenceid=21, filesize=5.0 K 2023-04-09 15:53:47,017 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c2e5a80bc0a57b639d176e9f52480137 in 111ms, sequenceid=21, compaction requested=true 2023-04-09 15:53:47,018 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:47,018 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:47,018 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:47,019 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:47,019 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,020 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-09 15:53:47,020 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-09 15:53:47,026 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,026 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:47,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:47,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:47,028 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,028 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:47,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:47,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:47,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-09 15:53:47,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@223f7274[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:47,030 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-09 15:53:47,031 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,032 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,032 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-09 15:53:47,032 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-09 15:53:47,032 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:47,033 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,033 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:47,034 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-09 15:53:47,034 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,034 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:47,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:47,035 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-09 15:53:47,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:47,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:47,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:47,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:47,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:47,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-09 15:53:47,041 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-09 15:53:47,041 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:47,041 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:47,041 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,041 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:47,044 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:47,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:47,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:47,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:47,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:47,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,052 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,052 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:47,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:47,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:47,053 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,056 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,059 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,059 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,059 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:47,059 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:47,060 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:47,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:47,060 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:47,059 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:47,060 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:47,061 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,061 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,061 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:47,061 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:47,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:47,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:47,124 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-04-09 15:53:47,125 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-04-09 15:53:47,161 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:47,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:47,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:47,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-04-09 15:53:47,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,179 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:47,179 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:47,179 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-09 15:53:47,180 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-09 15:53:47,180 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,180 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,182 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:47,182 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:47,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,183 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,183 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,184 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,187 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-04-09 15:53:47,187 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,187 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-09 15:53:47,187 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:47,188 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-09 15:53:47,189 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:47,189 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:47,189 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:47,189 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. started... 2023-04-09 15:53:47,189 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c2e5a80bc0a57b639d176e9f52480137 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:53:47,233 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231269935a6a5fe4cb994c4b3a6ec09c069 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231269935a6a5fe4cb994c4b3a6ec09c069 2023-04-09 15:53:47,254 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/4940cf4ef2e04c5887beb01dd92c531d 2023-04-09 15:53:47,266 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/4940cf4ef2e04c5887beb01dd92c531d as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/4940cf4ef2e04c5887beb01dd92c531d 2023-04-09 15:53:47,284 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/4940cf4ef2e04c5887beb01dd92c531d, entries=1, sequenceid=25, filesize=5.0 K 2023-04-09 15:53:47,287 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c2e5a80bc0a57b639d176e9f52480137 in 98ms, sequenceid=25, compaction requested=true 2023-04-09 15:53:47,287 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:47,287 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:47,287 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:47,288 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:47,288 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,288 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-09 15:53:47,288 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-09 15:53:47,290 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,290 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:47,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:47,291 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,291 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:47,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:47,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:47,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:47,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-09 15:53:47,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@139416d[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:47,297 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-09 15:53:47,297 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,299 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,299 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-09 15:53:47,299 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-09 15:53:47,299 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:47,300 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,300 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:47,302 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-09 15:53:47,302 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:47,302 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-09 15:53:47,302 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:47,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:47,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:47,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:47,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:47,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:47,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-09 15:53:47,309 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-09 15:53:47,309 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:47,309 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:47,309 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,309 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:47,311 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,311 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,311 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:47,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:47,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:47,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:47,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:47,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,312 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:47,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:47,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,315 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:47,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,318 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,318 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,318 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:47,319 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:47,319 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,319 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,319 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,319 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,319 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,319 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:47,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-04-09 15:53:47,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:47,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:47,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:47,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:47,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:47,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:47,320 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:47,320 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:47,421 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:47,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:47,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:47,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-04-09 15:53:47,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,452 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:47,452 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:47,453 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-09 15:53:47,453 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-09 15:53:47,453 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,453 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,457 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,457 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,457 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:47,457 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:47,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:47,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:47,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:47,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,464 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,466 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-04-09 15:53:47,466 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,466 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-09 15:53:47,466 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:47,467 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-09 15:53:47,467 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:47,467 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:47,467 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:47,467 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. started... 2023-04-09 15:53:47,468 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c2e5a80bc0a57b639d176e9f52480137 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:53:47,526 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010153733b0cb5f04753ba22c36a54c258ef to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010153733b0cb5f04753ba22c36a54c258ef 2023-04-09 15:53:47,602 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/f545df11761445a7ba640865504a75dc 2023-04-09 15:53:47,618 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/f545df11761445a7ba640865504a75dc as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/f545df11761445a7ba640865504a75dc 2023-04-09 15:53:47,639 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/f545df11761445a7ba640865504a75dc, entries=1, sequenceid=29, filesize=5.0 K 2023-04-09 15:53:47,641 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c2e5a80bc0a57b639d176e9f52480137 in 173ms, sequenceid=29, compaction requested=true 2023-04-09 15:53:47,641 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:47,642 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:47,642 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:47,642 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:47,642 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,642 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-09 15:53:47,642 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-09 15:53:47,646 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,646 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:47,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:47,646 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,646 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:47,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:47,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:47,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:47,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-09 15:53:47,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d3df0bb[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:47,651 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-09 15:53:47,651 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,653 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,653 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-09 15:53:47,653 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-09 15:53:47,653 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:47,654 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,654 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:47,657 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:47,657 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-09 15:53:47,657 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:47,657 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-09 15:53:47,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:47,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:47,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:47,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:47,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:47,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-09 15:53:47,667 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-09 15:53:47,667 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:47,667 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:47,667 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,667 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:47,677 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,678 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:47,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,678 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:47,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:47,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:47,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:47,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:47,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,681 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:47,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,685 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:47,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,698 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:47,698 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:47,698 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,699 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,699 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,699 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:47,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:47,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:47,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:47,699 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,700 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,700 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,700 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-04-09 15:53:47,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:47,700 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:47,700 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:47,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:47,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:47,801 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:47,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:47,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:47,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-04-09 15:53:47,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,819 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:47,820 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:47,820 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-09 15:53:47,820 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-09 15:53:47,821 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,821 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,822 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:47,822 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:47,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:47,823 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,824 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:47,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:47,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,825 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,825 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-04-09 15:53:47,825 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,825 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-09 15:53:47,826 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:47,826 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-09 15:53:47,832 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:47,832 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:47,832 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:47,832 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. started... 2023-04-09 15:53:47,832 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c2e5a80bc0a57b639d176e9f52480137 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:53:47,902 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030f852a0dc35b47a58353ce8ac504a2ca to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601030f852a0dc35b47a58353ce8ac504a2ca 2023-04-09 15:53:47,926 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/ecd766f8473b4f92a3565ad574fa61f4 2023-04-09 15:53:47,938 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/ecd766f8473b4f92a3565ad574fa61f4 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/ecd766f8473b4f92a3565ad574fa61f4 2023-04-09 15:53:47,953 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/ecd766f8473b4f92a3565ad574fa61f4, entries=1, sequenceid=33, filesize=5.0 K 2023-04-09 15:53:47,955 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c2e5a80bc0a57b639d176e9f52480137 in 123ms, sequenceid=33, compaction requested=true 2023-04-09 15:53:47,955 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:47,955 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:47,955 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:47,956 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:47,956 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,956 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-09 15:53:47,956 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-09 15:53:47,958 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,958 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:47,958 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,958 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:47,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:47,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:47,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:47,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-09 15:53:47,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@296d4399[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:47,961 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-09 15:53:47,961 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,962 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,963 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-09 15:53:47,963 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-09 15:53:47,963 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:47,963 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,963 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:47,966 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,966 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-09 15:53:47,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:47,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:47,966 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:47,966 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-09 15:53:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:47,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:47,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:47,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-09 15:53:47,971 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-09 15:53:47,971 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:47,971 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:47,971 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,971 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:47,973 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,973 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:47,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:47,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:47,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,975 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,977 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,978 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:47,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:47,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:47,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:47,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:47,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,985 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:47,985 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:47,986 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:47,985 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:47,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:47,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:47,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:47,986 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,986 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,987 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:47,987 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,987 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,987 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:47,987 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:47,987 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:47,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:47,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:48,087 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:48,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:48,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:48,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-04-09 15:53:48,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,106 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:48,106 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:48,106 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-09 15:53:48,106 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-09 15:53:48,107 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,107 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,108 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:48,108 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,109 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,109 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:48,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,111 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,116 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-04-09 15:53:48,116 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,116 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-09 15:53:48,118 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:48,118 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-09 15:53:48,120 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:48,120 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:48,120 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:48,120 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. started... 2023-04-09 15:53:48,120 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c2e5a80bc0a57b639d176e9f52480137 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:53:48,167 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907daf157a59d174a20931eb4c99a4eb75b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907daf157a59d174a20931eb4c99a4eb75b 2023-04-09 15:53:48,584 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/1bed4a6966de437a93720888b55ec641 2023-04-09 15:53:48,595 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/1bed4a6966de437a93720888b55ec641 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/1bed4a6966de437a93720888b55ec641 2023-04-09 15:53:48,602 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/1bed4a6966de437a93720888b55ec641, entries=1, sequenceid=37, filesize=5.0 K 2023-04-09 15:53:48,603 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c2e5a80bc0a57b639d176e9f52480137 in 483ms, sequenceid=37, compaction requested=true 2023-04-09 15:53:48,604 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:48,604 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:48,604 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:48,604 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:48,604 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,605 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-09 15:53:48,605 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-09 15:53:48,608 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,608 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:48,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:48,608 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,608 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:48,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:48,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:48,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:48,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-09 15:53:48,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70982812[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:48,610 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-09 15:53:48,610 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,612 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,612 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-09 15:53:48,612 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-09 15:53:48,612 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:48,612 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,612 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:48,613 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-09 15:53:48,613 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,614 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:48,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:48,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:48,614 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-09 15:53:48,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:48,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:48,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-09 15:53:48,621 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-09 15:53:48,621 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:48,621 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:48,621 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,621 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:48,623 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,623 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,623 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:48,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:48,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:48,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:48,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:48,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:48,624 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:48,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,626 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:48,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,629 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:48,629 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:48,629 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:48,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-04-09 15:53:48,629 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:48,630 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,630 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:48,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:48,630 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:48,630 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,630 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,631 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:48,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:48,631 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:48,631 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:48,731 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:48,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:48,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:48,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-04-09 15:53:48,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,743 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:48,743 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:48,743 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-04-09 15:53:48,743 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-04-09 15:53:48,744 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,744 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,746 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:48,746 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:48,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:48,746 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:48,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,746 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:48,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:48,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,748 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,748 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-04-09 15:53:48,749 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:48,749 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-04-09 15:53:48,749 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:48,750 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-04-09 15:53:48,752 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:48,752 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:48,752 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:48,752 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. started... 2023-04-09 15:53:48,752 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c2e5a80bc0a57b639d176e9f52480137 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:53:48,783 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511203fb501717d4045469b0e2eca7453b76b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511203fb501717d4045469b0e2eca7453b76b 2023-04-09 15:53:49,195 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/cac5878670f34c328e9c1107a0ce8c27 2023-04-09 15:53:49,214 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/cac5878670f34c328e9c1107a0ce8c27 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/cac5878670f34c328e9c1107a0ce8c27 2023-04-09 15:53:49,223 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/cac5878670f34c328e9c1107a0ce8c27, entries=1, sequenceid=41, filesize=5.0 K 2023-04-09 15:53:49,225 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c2e5a80bc0a57b639d176e9f52480137 in 473ms, sequenceid=41, compaction requested=true 2023-04-09 15:53:49,225 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:49,225 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:49,225 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:49,226 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:49,226 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:49,226 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-04-09 15:53:49,226 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-04-09 15:53:49,227 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:49,227 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,228 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,228 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:49,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:49,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:49,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:49,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:49,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:49,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:49,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:49,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-04-09 15:53:49,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3be12d45[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:49,231 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-04-09 15:53:49,231 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,233 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,233 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-04-09 15:53:49,233 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-04-09 15:53:49,233 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:49,234 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:49,234 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:49,239 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:49,239 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-04-09 15:53:49,239 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:49,239 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-04-09 15:53:49,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:49,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:49,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:49,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:49,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:49,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:49,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:49,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:49,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:49,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-04-09 15:53:49,246 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-04-09 15:53:49,246 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:49,246 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:49,246 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,246 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:49,249 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:49,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:49,250 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,250 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:49,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:49,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:49,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:49,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,251 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:49,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:49,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:49,253 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:49,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:49,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:49,256 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:49,256 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:49,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:49,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:49,256 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:49,256 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,256 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,256 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:49,256 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,256 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,256 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,256 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:49,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-04-09 15:53:49,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:49,257 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:49,257 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:49,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:49,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:49,357 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:49,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:49,366 DEBUG [Listener at localhost/39283] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-04-09 15:53:49,369 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-04-09 15:53:49,374 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33617] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:49,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-04-09 15:53:49,406 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-04-09 15:53:49,408 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1681056229408 2023-04-09 15:53:49,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:53:49,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-09 15:53:49,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-04-09 15:53:49,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-09 15:53:49,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] zookeeper.ReadOnlyZKClient(139): Connect 0x4ba5e869 to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:53:49,421 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7671aa39, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:53:49,425 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-09 15:53:49,562 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b5e696a3bde241acbce792dfc7a54742 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b5e696a3bde241acbce792dfc7a54742 2023-04-09 15:53:49,563 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-09 15:53:49,586 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:53:49,588 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53292, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:53:49,602 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-09 15:53:49,605 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54604, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-09 15:53:49,652 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b42f707921594e79b18457f996099dbe first=Optional[r3] last=Optional[r6] 2023-04-09 15:53:49,690 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b42f707921594e79b18457f996099dbe}] 2023-04-09 15:53:49,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b42f707921594e79b18457f996099dbe for inclusion in c2e5a80bc0a57b639d176e9f52480137/family1 2023-04-09 15:53:49,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-04-09 15:53:49,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:53:49,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:49,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b42f707921594e79b18457f996099dbe to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gqt0ea96394oc6p42kr1nlagmntak3rr3ma278s7srbep254cqfnhuj7s8bji1os/family1/b42f707921594e79b18457f996099dbe 2023-04-09 15:53:49,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gqt0ea96394oc6p42kr1nlagmntak3rr3ma278s7srbep254cqfnhuj7s8bji1os/family1/b42f707921594e79b18457f996099dbe as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/8abd9d47b5594cde9604f298643fb7ea_SeqId_44_ 2023-04-09 15:53:49,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gqt0ea96394oc6p42kr1nlagmntak3rr3ma278s7srbep254cqfnhuj7s8bji1os/family1/b42f707921594e79b18457f996099dbe into c2e5a80bc0a57b639d176e9f52480137/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/8abd9d47b5594cde9604f298643fb7ea_SeqId_44_ - updating store file list. 2023-04-09 15:53:49,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/8abd9d47b5594cde9604f298643fb7ea_SeqId_44_ into c2e5a80bc0a57b639d176e9f52480137/family1 2023-04-09 15:53:49,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gqt0ea96394oc6p42kr1nlagmntak3rr3ma278s7srbep254cqfnhuj7s8bji1os/family1/b42f707921594e79b18457f996099dbe into c2e5a80bc0a57b639d176e9f52480137/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/8abd9d47b5594cde9604f298643fb7ea_SeqId_44_) 2023-04-09 15:53:49,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gqt0ea96394oc6p42kr1nlagmntak3rr3ma278s7srbep254cqfnhuj7s8bji1os/family1/b42f707921594e79b18457f996099dbe 2023-04-09 15:53:49,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-04-09 15:53:49,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-04-09 15:53:49,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(1912): c2e5a80bc0a57b639d176e9f52480137/family1 is initiating minor compaction 2023-04-09 15:53:49,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3bce44b3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:53:49,776 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c2e5a80bc0a57b639d176e9f52480137/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:49,777 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/aecbb9c6375f47fc96208c3ff06c8428, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/747960a2adff4aba885b421dd5143979, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/9bdcbdfc5a4e42c0bee1da8d69980af4, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/fc764212fd09418ca116887e3cd530e2, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/4940cf4ef2e04c5887beb01dd92c531d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/f545df11761445a7ba640865504a75dc, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/ecd766f8473b4f92a3565ad574fa61f4, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/1bed4a6966de437a93720888b55ec641, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/cac5878670f34c328e9c1107a0ce8c27, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/8abd9d47b5594cde9604f298643fb7ea_SeqId_44_] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp, totalSize=50.2 K 2023-04-09 15:53:49,778 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting aecbb9c6375f47fc96208c3ff06c8428, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-04-09 15:53:49,778 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 747960a2adff4aba885b421dd5143979, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-04-09 15:53:49,778 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 9bdcbdfc5a4e42c0bee1da8d69980af4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-04-09 15:53:49,778 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting fc764212fd09418ca116887e3cd530e2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-04-09 15:53:49,778 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 4940cf4ef2e04c5887beb01dd92c531d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-04-09 15:53:49,778 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting f545df11761445a7ba640865504a75dc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-04-09 15:53:49,778 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting ecd766f8473b4f92a3565ad574fa61f4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-04-09 15:53:49,778 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 1bed4a6966de437a93720888b55ec641, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-04-09 15:53:49,779 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting cac5878670f34c328e9c1107a0ce8c27, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-04-09 15:53:49,779 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 8abd9d47b5594cde9604f298643fb7ea_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-04-09 15:53:49,805 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-09 15:53:49,807 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:53:49,815 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512285b95ac88515e4aaba6ae186e398e4fe6 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512285b95ac88515e4aaba6ae186e398e4fe6 2023-04-09 15:53:49,818 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231269935a6a5fe4cb994c4b3a6ec09c069 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231269935a6a5fe4cb994c4b3a6ec09c069 2023-04-09 15:53:49,825 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010153733b0cb5f04753ba22c36a54c258ef to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010153733b0cb5f04753ba22c36a54c258ef 2023-04-09 15:53:49,834 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601030f852a0dc35b47a58353ce8ac504a2ca to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601030f852a0dc35b47a58353ce8ac504a2ca 2023-04-09 15:53:49,835 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-04-09 15:53:49,835 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-04-09 15:53:49,836 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-09 15:53:49,836 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-09 15:53:49,836 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-09 15:53:49,836 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-09 15:53:49,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-09 15:53:49,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-09 15:53:49,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-09 15:53:49,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-09 15:53:49,909 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] throttle.PressureAwareThroughputController(145): c2e5a80bc0a57b639d176e9f52480137#family1#compaction#10 average throughput is 0.16 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:53:50,369 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/0e7f854e0c2e460497d64b66399aba0b as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/0e7f854e0c2e460497d64b66399aba0b 2023-04-09 15:53:50,390 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in c2e5a80bc0a57b639d176e9f52480137/family1 of c2e5a80bc0a57b639d176e9f52480137 into 0e7f854e0c2e460497d64b66399aba0b(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:53:50,390 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:50,392 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1681055629773; duration=0sec 2023-04-09 15:53:50,393 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:53:50,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/aecbb9c6375f47fc96208c3ff06c8428, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/747960a2adff4aba885b421dd5143979, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/9bdcbdfc5a4e42c0bee1da8d69980af4, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/fc764212fd09418ca116887e3cd530e2, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/4940cf4ef2e04c5887beb01dd92c531d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/f545df11761445a7ba640865504a75dc, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/ecd766f8473b4f92a3565ad574fa61f4, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/1bed4a6966de437a93720888b55ec641, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/cac5878670f34c328e9c1107a0ce8c27, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/8abd9d47b5594cde9604f298643fb7ea_SeqId_44_] to archive 2023-04-09 15:53:50,461 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512059a5a471ba0144b868f6a3d38eb8323f8 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512059a5a471ba0144b868f6a3d38eb8323f8 2023-04-09 15:53:50,462 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:53:50,464 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-09 15:53:50,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/aecbb9c6375f47fc96208c3ff06c8428 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/aecbb9c6375f47fc96208c3ff06c8428 2023-04-09 15:53:50,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/747960a2adff4aba885b421dd5143979 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/747960a2adff4aba885b421dd5143979 2023-04-09 15:53:50,473 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/9bdcbdfc5a4e42c0bee1da8d69980af4 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/9bdcbdfc5a4e42c0bee1da8d69980af4 2023-04-09 15:53:50,475 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/fc764212fd09418ca116887e3cd530e2 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/fc764212fd09418ca116887e3cd530e2 2023-04-09 15:53:50,477 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/4940cf4ef2e04c5887beb01dd92c531d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/4940cf4ef2e04c5887beb01dd92c531d 2023-04-09 15:53:50,479 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/f545df11761445a7ba640865504a75dc to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/f545df11761445a7ba640865504a75dc 2023-04-09 15:53:50,481 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/ecd766f8473b4f92a3565ad574fa61f4 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/ecd766f8473b4f92a3565ad574fa61f4 2023-04-09 15:53:50,483 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/1bed4a6966de437a93720888b55ec641 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/1bed4a6966de437a93720888b55ec641 2023-04-09 15:53:50,485 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/cac5878670f34c328e9c1107a0ce8c27 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/cac5878670f34c328e9c1107a0ce8c27 2023-04-09 15:53:50,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/8abd9d47b5594cde9604f298643fb7ea_SeqId_44_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/8abd9d47b5594cde9604f298643fb7ea_SeqId_44_ 2023-04-09 15:53:50,538 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/166a7c720aa2416b9f3eb4fe4b87e806 first=Optional[r00] last=Optional[r2] 2023-04-09 15:53:50,541 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/166a7c720aa2416b9f3eb4fe4b87e806}] 2023-04-09 15:53:50,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/166a7c720aa2416b9f3eb4fe4b87e806 for inclusion in c2e5a80bc0a57b639d176e9f52480137/family1 2023-04-09 15:53:50,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-04-09 15:53:50,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:53:50,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:50,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/166a7c720aa2416b9f3eb4fe4b87e806 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__eq870m0srr27oaur9hocvek3u8rto93hucs63sgjgp8l965462u7t4si7mfltalr/family1/166a7c720aa2416b9f3eb4fe4b87e806 2023-04-09 15:53:50,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__eq870m0srr27oaur9hocvek3u8rto93hucs63sgjgp8l965462u7t4si7mfltalr/family1/166a7c720aa2416b9f3eb4fe4b87e806 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/0663c07394ce4da4a150e552b8c073af_SeqId_47_ 2023-04-09 15:53:50,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__eq870m0srr27oaur9hocvek3u8rto93hucs63sgjgp8l965462u7t4si7mfltalr/family1/166a7c720aa2416b9f3eb4fe4b87e806 into c2e5a80bc0a57b639d176e9f52480137/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/0663c07394ce4da4a150e552b8c073af_SeqId_47_ - updating store file list. 2023-04-09 15:53:50,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/0663c07394ce4da4a150e552b8c073af_SeqId_47_ into c2e5a80bc0a57b639d176e9f52480137/family1 2023-04-09 15:53:50,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__eq870m0srr27oaur9hocvek3u8rto93hucs63sgjgp8l965462u7t4si7mfltalr/family1/166a7c720aa2416b9f3eb4fe4b87e806 into c2e5a80bc0a57b639d176e9f52480137/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/0663c07394ce4da4a150e552b8c073af_SeqId_47_) 2023-04-09 15:53:50,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__eq870m0srr27oaur9hocvek3u8rto93hucs63sgjgp8l965462u7t4si7mfltalr/family1/166a7c720aa2416b9f3eb4fe4b87e806 2023-04-09 15:53:50,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-04-09 15:53:50,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-04-09 15:53:50,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(1912): c2e5a80bc0a57b639d176e9f52480137/family1 is initiating minor compaction (all files) 2023-04-09 15:53:50,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@170d3686; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:53:50,576 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c2e5a80bc0a57b639d176e9f52480137/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:50,577 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/d790845739ae42c3b6fe55dd5ec619b1, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/0e7f854e0c2e460497d64b66399aba0b, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/0663c07394ce4da4a150e552b8c073af_SeqId_47_] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp, totalSize=358.6 K 2023-04-09 15:53:50,578 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting d790845739ae42c3b6fe55dd5ec619b1, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842473 2023-04-09 15:53:50,579 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 0e7f854e0c2e460497d64b66399aba0b, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242473 2023-04-09 15:53:50,580 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 0663c07394ce4da4a150e552b8c073af_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878842473 2023-04-09 15:53:50,584 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-09 15:53:50,586 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:53:50,588 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511300ffa0fafce074eb0ab144673a8cbe55a to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511300ffa0fafce074eb0ab144673a8cbe55a 2023-04-09 15:53:50,590 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201233da41d10b14249adf225602ba6cedd to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201233da41d10b14249adf225602ba6cedd 2023-04-09 15:53:50,592 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205d3a0f8ae31a34b53af15cec2be091eaf to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205d3a0f8ae31a34b53af15cec2be091eaf 2023-04-09 15:53:50,592 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-04-09 15:53:50,592 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-04-09 15:53:50,594 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-09 15:53:50,594 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-09 15:53:50,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:53:50,596 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-04-09 15:53:50,599 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.2020 sec 2023-04-09 15:53:50,647 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] throttle.PressureAwareThroughputController(145): c2e5a80bc0a57b639d176e9f52480137#family1#compaction#11 average throughput is 3.44 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:53:50,764 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/.tmp/family1/26ca1ae42d074523bfaf92f1ff7e21b7 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/26ca1ae42d074523bfaf92f1ff7e21b7 2023-04-09 15:53:50,785 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c2e5a80bc0a57b639d176e9f52480137/family1 of c2e5a80bc0a57b639d176e9f52480137 into 26ca1ae42d074523bfaf92f1ff7e21b7(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:53:50,785 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:50,786 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1681055630576; duration=0sec 2023-04-09 15:53:50,786 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:53:50,844 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/d790845739ae42c3b6fe55dd5ec619b1, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/0e7f854e0c2e460497d64b66399aba0b, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/0663c07394ce4da4a150e552b8c073af_SeqId_47_] to archive 2023-04-09 15:53:50,848 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:53:50,850 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/d790845739ae42c3b6fe55dd5ec619b1 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/d790845739ae42c3b6fe55dd5ec619b1 2023-04-09 15:53:50,853 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/0e7f854e0c2e460497d64b66399aba0b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/0e7f854e0c2e460497d64b66399aba0b 2023-04-09 15:53:50,855 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/0663c07394ce4da4a150e552b8c073af_SeqId_47_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/0663c07394ce4da4a150e552b8c073af_SeqId_47_ 2023-04-09 15:53:50,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-04-09 15:53:50,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:50,913 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-04-09 15:53:50,915 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-04-09 15:53:50,915 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-04-09 15:53:50,921 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-04-09 15:53:50,938 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c2e5a80bc0a57b639d176e9f52480137, REOPEN/MOVE}] 2023-04-09 15:53:50,939 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c2e5a80bc0a57b639d176e9f52480137, REOPEN/MOVE 2023-04-09 15:53:50,941 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c2e5a80bc0a57b639d176e9f52480137, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:50,941 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1681055630940"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055630940"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055630940"}]},"ts":"1681055630940"} 2023-04-09 15:53:50,944 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure c2e5a80bc0a57b639d176e9f52480137, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:53:51,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:53:51,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c2e5a80bc0a57b639d176e9f52480137, disabling compactions & flushes 2023-04-09 15:53:51,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:51,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:51,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. after waiting 0 ms 2023-04-09 15:53:51,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:51,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-04-09 15:53:51,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:51,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:51,115 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: c2e5a80bc0a57b639d176e9f52480137 to self. 2023-04-09 15:53:51,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:53:51,119 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c2e5a80bc0a57b639d176e9f52480137, regionState=CLOSED 2023-04-09 15:53:51,119 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1681055631118"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055631118"}]},"ts":"1681055631118"} 2023-04-09 15:53:51,124 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-04-09 15:53:51,124 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure c2e5a80bc0a57b639d176e9f52480137, server=jenkins-hbase4.apache.org,44869,1681055618167 in 177 msec 2023-04-09 15:53:51,125 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c2e5a80bc0a57b639d176e9f52480137, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=true 2023-04-09 15:53:51,276 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c2e5a80bc0a57b639d176e9f52480137, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:51,276 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1681055631276"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055631276"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055631276"}]},"ts":"1681055631276"} 2023-04-09 15:53:51,280 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure c2e5a80bc0a57b639d176e9f52480137, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:53:51,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:51,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c2e5a80bc0a57b639d176e9f52480137, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137.', STARTKEY => '', ENDKEY => ''} 2023-04-09 15:53:51,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:53:51,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:53:51,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:53:51,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:53:51,439 INFO [StoreOpener-c2e5a80bc0a57b639d176e9f52480137-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:53:51,441 DEBUG [StoreOpener-c2e5a80bc0a57b639d176e9f52480137-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1 2023-04-09 15:53:51,441 DEBUG [StoreOpener-c2e5a80bc0a57b639d176e9f52480137-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1 2023-04-09 15:53:51,442 INFO [StoreOpener-c2e5a80bc0a57b639d176e9f52480137-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2e5a80bc0a57b639d176e9f52480137 columnFamilyName family1 2023-04-09 15:53:51,451 DEBUG [StoreOpener-c2e5a80bc0a57b639d176e9f52480137-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/26ca1ae42d074523bfaf92f1ff7e21b7 2023-04-09 15:53:51,451 INFO [StoreOpener-c2e5a80bc0a57b639d176e9f52480137-1] regionserver.HStore(310): Store=c2e5a80bc0a57b639d176e9f52480137/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:53:51,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:53:51,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:53:51,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:53:51,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c2e5a80bc0a57b639d176e9f52480137; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71657853, jitterRate=0.06778521835803986}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-09 15:53:51,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:51,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137., pid=17, masterSystemTime=1681055631432 2023-04-09 15:53:51,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:51,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:53:51,470 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c2e5a80bc0a57b639d176e9f52480137, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:51,470 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1681055631470"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055631470"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055631470"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055631470"}]},"ts":"1681055631470"} 2023-04-09 15:53:51,479 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-04-09 15:53:51,479 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure c2e5a80bc0a57b639d176e9f52480137, server=jenkins-hbase4.apache.org,44869,1681055618167 in 196 msec 2023-04-09 15:53:51,482 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-04-09 15:53:51,483 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c2e5a80bc0a57b639d176e9f52480137, REOPEN/MOVE in 541 msec 2023-04-09 15:53:51,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-04-09 15:53:51,490 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 565 msec 2023-04-09 15:53:51,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 608 msec 2023-04-09 15:53:51,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-04-09 15:53:51,509 INFO [Listener at localhost/39283] compactions.TestMobCompactor(278): alter status finished 2023-04-09 15:53:51,510 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33617] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-04-09 15:53:51,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-04-09 15:53:51,522 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-04-09 15:53:51,523 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1681056231523 2023-04-09 15:53:51,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:53:51,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-09 15:53:51,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-04-09 15:53:51,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-09 15:53:51,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] zookeeper.ReadOnlyZKClient(139): Connect 0x6d0351aa to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:53:51,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b8c01b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:53:51,541 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-09 15:53:51,542 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-09 15:53:51,542 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-09 15:53:51,542 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-09 15:53:51,542 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-09 15:53:52,011 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286f805f48d227490eb9ed988508641539 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511286f805f48d227490eb9ed988508641539 2023-04-09 15:53:52,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-09 15:53:52,027 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:53:52,029 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:53:52,039 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-09 15:53:52,042 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54620, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-09 15:53:52,086 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f1e0e7bae48540d49874e900f1079426 first=Optional[r05] last=Optional[r8] 2023-04-09 15:53:52,087 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=51 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f1e0e7bae48540d49874e900f1079426}] 2023-04-09 15:53:52,095 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f1e0e7bae48540d49874e900f1079426 for inclusion in c2e5a80bc0a57b639d176e9f52480137/family1 2023-04-09 15:53:52,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-04-09 15:53:52,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:53:52,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:53:52,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f1e0e7bae48540d49874e900f1079426 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__q9spd9eq9k58hon1jil2fum0lc5teru0vgg8gchssq932do9g3ppelefv8v7l8nu/family1/f1e0e7bae48540d49874e900f1079426 2023-04-09 15:53:52,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__q9spd9eq9k58hon1jil2fum0lc5teru0vgg8gchssq932do9g3ppelefv8v7l8nu/family1/f1e0e7bae48540d49874e900f1079426 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/1b48dddcd33a4da598791584cf1115fe_SeqId_53_ 2023-04-09 15:53:52,106 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__q9spd9eq9k58hon1jil2fum0lc5teru0vgg8gchssq932do9g3ppelefv8v7l8nu/family1/f1e0e7bae48540d49874e900f1079426 into c2e5a80bc0a57b639d176e9f52480137/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/1b48dddcd33a4da598791584cf1115fe_SeqId_53_ - updating store file list. 2023-04-09 15:53:52,115 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/1b48dddcd33a4da598791584cf1115fe_SeqId_53_ into c2e5a80bc0a57b639d176e9f52480137/family1 2023-04-09 15:53:52,115 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__q9spd9eq9k58hon1jil2fum0lc5teru0vgg8gchssq932do9g3ppelefv8v7l8nu/family1/f1e0e7bae48540d49874e900f1079426 into c2e5a80bc0a57b639d176e9f52480137/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/family1/1b48dddcd33a4da598791584cf1115fe_SeqId_53_) 2023-04-09 15:53:52,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__q9spd9eq9k58hon1jil2fum0lc5teru0vgg8gchssq932do9g3ppelefv8v7l8nu/family1/f1e0e7bae48540d49874e900f1079426 2023-04-09 15:53:52,119 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-09 15:53:52,120 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:53:52,122 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511203fb501717d4045469b0e2eca7453b76b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511203fb501717d4045469b0e2eca7453b76b 2023-04-09 15:53:52,132 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128413d562fac064111bcca78fe5bbec047 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128413d562fac064111bcca78fe5bbec047 2023-04-09 15:53:52,132 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-04-09 15:53:52,132 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-04-09 15:53:52,133 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-09 15:53:52,133 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-09 15:53:52,133 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-04-09 15:53:52,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-04-09 15:53:52,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:53:52,137 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-04-09 15:53:52,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 626 msec 2023-04-09 15:53:52,278 INFO [Listener at localhost/39283] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=253 (was 211) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55080 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64813@0x4ba5e869-SendThread(127.0.0.1:64813) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55056 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55034 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55278 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55212 [Waiting for operation #25] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x437aba8b-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55134 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55300 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64813@0x6d0351aa sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/2122450043.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55312 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64813@0x6d0351aa-SendThread(127.0.0.1:64813) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55182 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd8b1a3f-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:44869-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x437aba8b-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64813@0x4ba5e869 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/2122450043.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55166 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55114 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xd8b1a3f-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55196 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x437aba8b-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x437aba8b-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x437aba8b-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55286 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55156 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0xd8b1a3f-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1780325809_15 at /127.0.0.1:55094 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55262 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64813@0x6d0351aa-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64813@0x4ba5e869-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55190 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55328 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=606 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=317 (was 266) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=2053 (was 2446) 2023-04-09 15:53:52,300 INFO [Listener at localhost/39283] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=253, OpenFileDescriptor=606, MaxFileDescriptor=60000, SystemLoadAverage=317, ProcessCount=169, AvailableMemoryMB=2051 2023-04-09 15:53:52,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-04-09 15:53:52,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:52,310 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-04-09 15:53:52,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-04-09 15:53:52,311 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-09 15:53:52,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-04-09 15:53:52,324 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893 2023-04-09 15:53:52,328 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893 empty. 2023-04-09 15:53:52,329 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893 2023-04-09 15:53:52,329 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-04-09 15:53:52,386 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-04-09 15:53:52,412 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3f33dcb10aa0e9a7d71e3912baad4893, NAME => 'testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:53:52,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-04-09 15:53:52,446 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:53:52,446 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 3f33dcb10aa0e9a7d71e3912baad4893, disabling compactions & flushes 2023-04-09 15:53:52,446 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:52,446 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:52,446 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. after waiting 0 ms 2023-04-09 15:53:52,446 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:52,446 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:52,446 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 3f33dcb10aa0e9a7d71e3912baad4893: 2023-04-09 15:53:52,463 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-04-09 15:53:52,465 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1681055632464"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055632464"}]},"ts":"1681055632464"} 2023-04-09 15:53:52,469 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-04-09 15:53:52,470 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-09 15:53:52,471 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055632471"}]},"ts":"1681055632471"} 2023-04-09 15:53:52,473 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-04-09 15:53:52,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=3f33dcb10aa0e9a7d71e3912baad4893, ASSIGN}] 2023-04-09 15:53:52,479 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=3f33dcb10aa0e9a7d71e3912baad4893, ASSIGN 2023-04-09 15:53:52,481 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=3f33dcb10aa0e9a7d71e3912baad4893, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:53:52,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-04-09 15:53:52,632 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=3f33dcb10aa0e9a7d71e3912baad4893, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:52,633 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1681055632632"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055632632"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055632632"}]},"ts":"1681055632632"} 2023-04-09 15:53:52,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 3f33dcb10aa0e9a7d71e3912baad4893, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:53:52,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:52,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3f33dcb10aa0e9a7d71e3912baad4893, NAME => 'testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893.', STARTKEY => '', ENDKEY => ''} 2023-04-09 15:53:52,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 3f33dcb10aa0e9a7d71e3912baad4893 2023-04-09 15:53:52,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:53:52,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3f33dcb10aa0e9a7d71e3912baad4893 2023-04-09 15:53:52,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3f33dcb10aa0e9a7d71e3912baad4893 2023-04-09 15:53:52,798 INFO [StoreOpener-3f33dcb10aa0e9a7d71e3912baad4893-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3f33dcb10aa0e9a7d71e3912baad4893 2023-04-09 15:53:52,800 DEBUG [StoreOpener-3f33dcb10aa0e9a7d71e3912baad4893-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1 2023-04-09 15:53:52,800 DEBUG [StoreOpener-3f33dcb10aa0e9a7d71e3912baad4893-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1 2023-04-09 15:53:52,800 INFO [StoreOpener-3f33dcb10aa0e9a7d71e3912baad4893-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f33dcb10aa0e9a7d71e3912baad4893 columnFamilyName family1 2023-04-09 15:53:52,802 INFO [StoreOpener-3f33dcb10aa0e9a7d71e3912baad4893-1] regionserver.HStore(310): Store=3f33dcb10aa0e9a7d71e3912baad4893/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:53:52,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893 2023-04-09 15:53:52,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893 2023-04-09 15:53:52,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3f33dcb10aa0e9a7d71e3912baad4893 2023-04-09 15:53:52,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:53:52,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3f33dcb10aa0e9a7d71e3912baad4893; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67388801, jitterRate=0.004171386361122131}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-09 15:53:52,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3f33dcb10aa0e9a7d71e3912baad4893: 2023-04-09 15:53:52,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893., pid=21, masterSystemTime=1681055632789 2023-04-09 15:53:52,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:52,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:52,819 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=3f33dcb10aa0e9a7d71e3912baad4893, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:52,819 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1681055632819"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055632819"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055632819"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055632819"}]},"ts":"1681055632819"} 2023-04-09 15:53:52,825 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-04-09 15:53:52,825 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 3f33dcb10aa0e9a7d71e3912baad4893, server=jenkins-hbase4.apache.org,44869,1681055618167 in 186 msec 2023-04-09 15:53:52,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-04-09 15:53:52,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=3f33dcb10aa0e9a7d71e3912baad4893, ASSIGN in 349 msec 2023-04-09 15:53:52,830 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-09 15:53:52,830 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055632830"}]},"ts":"1681055632830"} 2023-04-09 15:53:52,832 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-04-09 15:53:52,836 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-04-09 15:53:52,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 533 msec 2023-04-09 15:53:52,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-04-09 15:53:52,919 INFO [Listener at localhost/39283] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-04-09 15:53:52,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:52,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:52,988 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:52,988 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:52,989 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:53:52,989 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:53:52,990 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:52,990 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:52,992 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:52,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:52,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:52,993 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:52,993 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:52,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:52,993 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:52,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:52,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:52,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:52,994 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:52,995 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:52,995 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:53:52,995 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:53,004 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:53:53,004 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:53,004 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:53,004 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:53,004 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. started... 2023-04-09 15:53:53,005 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3f33dcb10aa0e9a7d71e3912baad4893 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-04-09 15:53:53,072 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ea6130baef6c4c2eb438295655d9e912 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130ea6130baef6c4c2eb438295655d9e912 2023-04-09 15:53:53,078 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/0cbfa632a60b4b9dbde3f9c7e0972b68 2023-04-09 15:53:53,088 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/0cbfa632a60b4b9dbde3f9c7e0972b68 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/0cbfa632a60b4b9dbde3f9c7e0972b68 2023-04-09 15:53:53,095 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/0cbfa632a60b4b9dbde3f9c7e0972b68, entries=1000, sequenceid=5, filesize=166.0 K 2023-04-09 15:53:53,097 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 3f33dcb10aa0e9a7d71e3912baad4893 in 92ms, sequenceid=5, compaction requested=false 2023-04-09 15:53:53,097 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:53,098 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3f33dcb10aa0e9a7d71e3912baad4893: 2023-04-09 15:53:53,098 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:53,098 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:53,098 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:53,098 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:53,098 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:53:53,099 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:53:53,101 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,102 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:53,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:53,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:53,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:53,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:53,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:53,103 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,103 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:53,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:53,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:53,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:53:53,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@791baaaa[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:53,105 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:53:53,105 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,108 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,108 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:53:53,108 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:53:53,108 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:53,112 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:53:53,112 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:53,112 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:53:53,119 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:53,123 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:53:53,123 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:53,123 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:53:53,123 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:53,123 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:53,123 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,123 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:53,128 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:53,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:53,129 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,129 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:53,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:53,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,130 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:53,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:53,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:53,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:53,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:53,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:53,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,132 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:53,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:53,137 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:53,137 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:53,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:53,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:53,137 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:53,137 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,137 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,137 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:53,137 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,137 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,137 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:53,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:53,138 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:53,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:53,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:53,139 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:53,140 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:53,240 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:53,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:53,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:53,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:53:53,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,251 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:53,251 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:53,251 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:53:53,251 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:53:53,252 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,252 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,254 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:53,254 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:53,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:53,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:53,255 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:53,255 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:53,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,255 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:53,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,256 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,256 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-04-09 15:53:53,256 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:53,256 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:53:53,257 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:53,257 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:53:53,257 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:53,257 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:53,257 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:53,258 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. started... 2023-04-09 15:53:53,258 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3f33dcb10aa0e9a7d71e3912baad4893 1/1 column families, dataSize=74 B heapSize=408 B 2023-04-09 15:53:53,682 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f935689dd8c84cc88e44ab6b1df9dadf to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128f935689dd8c84cc88e44ab6b1df9dadf 2023-04-09 15:53:54,111 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/f4bd62ac16ab477da1a9c3bdc046a578 2023-04-09 15:53:54,123 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/f4bd62ac16ab477da1a9c3bdc046a578 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/f4bd62ac16ab477da1a9c3bdc046a578 2023-04-09 15:53:54,131 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/f4bd62ac16ab477da1a9c3bdc046a578, entries=1, sequenceid=9, filesize=5.0 K 2023-04-09 15:53:54,132 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 3f33dcb10aa0e9a7d71e3912baad4893 in 874ms, sequenceid=9, compaction requested=false 2023-04-09 15:53:54,132 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3f33dcb10aa0e9a7d71e3912baad4893: 2023-04-09 15:53:54,133 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:54,133 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:54,133 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:54,133 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,133 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:53:54,133 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:53:54,136 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:54,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:54,136 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:54,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:54,137 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,137 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:54,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:54,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:53:54,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3aa94f9b[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:54,138 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:53:54,138 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,140 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,140 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:53:54,140 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:53:54,140 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:54,141 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,141 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:54,142 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:53:54,142 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:54,142 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:53:54,143 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:54,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:54,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:54,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:54,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:54,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:54,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:53:54,147 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:53:54,147 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:54,147 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:54,147 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,148 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:54,150 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,150 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:54,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,150 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:54,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:54,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:54,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:54,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:54,151 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:54,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,153 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:54,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,158 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,158 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,158 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:54,158 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:54,158 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:54,158 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-09 15:53:54,158 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:54,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:54,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:54,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:54,158 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,159 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,159 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,159 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,159 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:54,160 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:54,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:54,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:54,260 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:54,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:54,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:54,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:53:54,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,270 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:54,270 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:54,270 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:53:54,270 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:53:54,271 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,271 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,272 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:54,272 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:54,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:54,273 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,273 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:54,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,274 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,274 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-04-09 15:53:54,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,274 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:53:54,274 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:54,275 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:53:54,275 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:54,275 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:54,275 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:54,275 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. started... 2023-04-09 15:53:54,275 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3f33dcb10aa0e9a7d71e3912baad4893 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:53:54,299 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120139e0db627d464eabb9302c540b452160 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120139e0db627d464eabb9302c540b452160 2023-04-09 15:53:54,314 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/3fbc9d3761744afc961c68cdb746c009 2023-04-09 15:53:54,323 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/3fbc9d3761744afc961c68cdb746c009 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/3fbc9d3761744afc961c68cdb746c009 2023-04-09 15:53:54,329 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/3fbc9d3761744afc961c68cdb746c009, entries=1, sequenceid=13, filesize=4.9 K 2023-04-09 15:53:54,330 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3f33dcb10aa0e9a7d71e3912baad4893 in 55ms, sequenceid=13, compaction requested=true 2023-04-09 15:53:54,330 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3f33dcb10aa0e9a7d71e3912baad4893: 2023-04-09 15:53:54,330 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:54,330 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:54,330 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:54,330 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,330 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:53:54,330 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:53:54,333 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,333 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:54,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:54,334 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,334 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:54,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:54,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:53:54,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b402864[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:54,336 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:53:54,336 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,338 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,338 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:53:54,338 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:53:54,338 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:54,338 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,338 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:54,340 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:53:54,340 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:54,340 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:53:54,341 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:54,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:54,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:54,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:54,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:54,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:54,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:53:54,344 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:53:54,344 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:54,344 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:54,344 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,344 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:54,346 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,346 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,346 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:54,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:54,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:54,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:54,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:54,347 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:54,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:54,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,349 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:54,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,353 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:54,353 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:54,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:54,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:54,353 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,353 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-09 15:53:54,353 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,353 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:54,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:54,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:54,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:54,353 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,354 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:54,353 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:54,354 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:54,354 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,354 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,354 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,454 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:54,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:54,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:54,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:53:54,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,466 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:54,466 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:54,467 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:53:54,467 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:53:54,468 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,468 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,469 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:54,469 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:54,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:54,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,470 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:54,470 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:54,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:54,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,470 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,472 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-04-09 15:53:54,472 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:54,472 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:53:54,472 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:54,473 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:53:54,480 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:54,480 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:54,480 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:54,480 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. started... 2023-04-09 15:53:54,480 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3f33dcb10aa0e9a7d71e3912baad4893 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:53:54,923 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058238e2d5972d45e19d7d5ce9096e30d4 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512058238e2d5972d45e19d7d5ce9096e30d4 2023-04-09 15:53:55,360 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/18992f3ba3414f20aa9c6aa0deec4dcb 2023-04-09 15:53:55,370 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/18992f3ba3414f20aa9c6aa0deec4dcb as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/18992f3ba3414f20aa9c6aa0deec4dcb 2023-04-09 15:53:55,376 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/18992f3ba3414f20aa9c6aa0deec4dcb, entries=1, sequenceid=17, filesize=4.9 K 2023-04-09 15:53:55,378 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3f33dcb10aa0e9a7d71e3912baad4893 in 898ms, sequenceid=17, compaction requested=true 2023-04-09 15:53:55,378 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3f33dcb10aa0e9a7d71e3912baad4893: 2023-04-09 15:53:55,378 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:55,378 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:55,378 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:55,378 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,378 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:53:55,378 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:53:55,380 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,380 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:55,380 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,380 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:55,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:55,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:55,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:53:55,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3979a74c[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:55,382 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:53:55,382 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,383 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,384 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:53:55,384 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:53:55,384 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:55,384 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,384 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:55,386 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,386 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:53:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:55,386 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:55,386 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:53:55,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:55,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:55,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:53:55,390 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:53:55,390 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:55,390 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:55,390 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,390 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:55,391 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,392 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:55,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:55,392 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:55,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:55,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:55,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:55,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,393 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:55,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,394 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:55,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,398 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:55,398 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:55,398 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:55,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:55,398 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,398 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,398 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,398 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,398 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,398 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:55,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:55,399 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:55,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:55,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:55,400 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:55,400 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:55,500 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:55,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:55,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:55,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:53:55,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,510 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:55,510 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:55,511 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:53:55,511 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:53:55,511 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,511 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,513 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:55,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:55,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:55,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:55,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,514 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,515 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-04-09 15:53:55,515 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,515 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:53:55,515 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:55,516 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:53:55,516 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,516 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:55,516 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:55,516 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:55,516 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. started... 2023-04-09 15:53:55,516 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3f33dcb10aa0e9a7d71e3912baad4893 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:53:55,517 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,517 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:55,946 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228a390422d89a843aa8d19e442243b2960 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228a390422d89a843aa8d19e442243b2960 2023-04-09 15:53:55,960 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/373ae31774a5463b806924e38e2af0c7 2023-04-09 15:53:55,968 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/373ae31774a5463b806924e38e2af0c7 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/373ae31774a5463b806924e38e2af0c7 2023-04-09 15:53:55,975 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/373ae31774a5463b806924e38e2af0c7, entries=1, sequenceid=21, filesize=4.9 K 2023-04-09 15:53:55,976 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3f33dcb10aa0e9a7d71e3912baad4893 in 460ms, sequenceid=21, compaction requested=true 2023-04-09 15:53:55,976 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3f33dcb10aa0e9a7d71e3912baad4893: 2023-04-09 15:53:55,976 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:55,976 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:55,977 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:55,977 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,977 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:53:55,977 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:53:55,978 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,978 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:55,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:55,979 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:55,979 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:55,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:55,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:55,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:53:55,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d130433[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:55,980 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:53:55,981 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,982 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,982 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:53:55,982 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:53:55,982 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:55,982 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,982 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:55,984 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:53:55,985 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,985 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:55,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:55,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:55,985 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:53:55,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:55,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:55,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:55,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:55,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:53:55,988 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:53:55,988 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:55,988 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:55,988 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,988 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:55,992 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,992 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:55,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:55,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:55,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,993 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:55,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:55,993 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:55,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:55,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:55,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:55,999 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:56,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,003 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:56,003 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:56,003 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,003 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,003 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,003 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,003 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,003 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,003 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:56,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:56,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:56,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:56,003 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:56,004 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:56,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-09 15:53:56,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:56,005 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:56,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:56,105 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:56,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:56,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:56,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:53:56,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,116 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:56,116 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:56,117 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:53:56,117 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:53:56,117 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,117 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,119 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:56,119 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:56,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:56,119 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,119 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:56,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,120 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:56,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,120 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,120 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-04-09 15:53:56,121 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,121 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:53:56,121 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:56,121 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:53:56,121 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:56,121 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:56,121 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:56,122 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. started... 2023-04-09 15:53:56,122 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3f33dcb10aa0e9a7d71e3912baad4893 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:53:56,550 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231abf29441027744edb8d2a814a748a703 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231abf29441027744edb8d2a814a748a703 2023-04-09 15:53:56,617 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-09 15:53:56,958 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/6f9acf2a3b53413980aa149b167b4e7a 2023-04-09 15:53:56,967 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/6f9acf2a3b53413980aa149b167b4e7a as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/6f9acf2a3b53413980aa149b167b4e7a 2023-04-09 15:53:56,972 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/6f9acf2a3b53413980aa149b167b4e7a, entries=1, sequenceid=25, filesize=4.9 K 2023-04-09 15:53:56,974 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3f33dcb10aa0e9a7d71e3912baad4893 in 852ms, sequenceid=25, compaction requested=true 2023-04-09 15:53:56,974 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3f33dcb10aa0e9a7d71e3912baad4893: 2023-04-09 15:53:56,974 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:56,974 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:56,974 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:56,974 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,974 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:53:56,974 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:53:56,976 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,976 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:56,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:56,976 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,976 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:56,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:56,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:56,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:56,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:53:56,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6db6559d[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:56,978 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:53:56,978 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,979 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,980 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:53:56,980 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:53:56,980 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:56,980 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,980 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:56,983 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,983 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:53:56,983 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:56,983 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:53:56,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:56,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:56,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:56,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:56,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:56,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:56,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:53:56,986 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:53:56,986 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:56,986 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:56,986 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,986 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:56,988 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,988 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:56,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:56,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,988 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:56,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:56,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:56,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:56,990 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:56,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,992 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:56,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,994 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,995 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:56,995 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:56,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:56,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:56,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-09 15:53:56,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:56,995 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:56,995 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,995 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:56,995 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:56,996 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,996 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:56,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:56,996 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:56,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:56,996 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:56,996 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,096 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:57,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:57,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:57,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:53:57,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,111 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:57,111 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:57,111 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:53:57,112 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:53:57,112 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,112 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,113 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:57,114 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:57,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:57,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,114 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,114 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:57,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:57,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,115 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,115 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-04-09 15:53:57,115 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,115 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:53:57,115 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:57,116 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:53:57,117 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:57,118 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:57,118 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:57,118 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. started... 2023-04-09 15:53:57,118 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3f33dcb10aa0e9a7d71e3912baad4893 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:53:57,148 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601018a6a772089e54d95b143fc3a37202d14 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601018a6a772089e54d95b143fc3a37202d14 2023-04-09 15:53:57,555 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/9f0874cc02d149c7937696bd62ba1547 2023-04-09 15:53:57,567 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/9f0874cc02d149c7937696bd62ba1547 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/9f0874cc02d149c7937696bd62ba1547 2023-04-09 15:53:57,576 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/9f0874cc02d149c7937696bd62ba1547, entries=1, sequenceid=29, filesize=4.9 K 2023-04-09 15:53:57,578 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3f33dcb10aa0e9a7d71e3912baad4893 in 460ms, sequenceid=29, compaction requested=true 2023-04-09 15:53:57,578 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3f33dcb10aa0e9a7d71e3912baad4893: 2023-04-09 15:53:57,578 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:57,578 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:57,578 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:57,578 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,578 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:53:57,578 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:53:57,580 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,580 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:57,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:57,580 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,580 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:57,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:57,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:57,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:57,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:53:57,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67bf4347[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:57,583 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:53:57,583 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,584 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,585 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:53:57,585 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:53:57,585 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:57,585 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,585 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:57,587 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:53:57,587 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:57,588 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:53:57,587 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:57,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:57,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:57,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:57,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:57,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:53:57,602 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:53:57,602 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:57,602 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:57,602 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,602 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:57,606 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,606 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,606 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:57,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:57,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:57,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:57,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:57,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:57,608 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:57,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,610 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:57,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,613 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,613 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,613 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,613 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:57,613 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:57,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:57,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:57,613 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,614 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,614 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,614 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:57,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:57,613 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:57,614 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:57,614 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:57,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:57,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:57,715 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:57,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:57,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:57,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:53:57,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,725 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:57,725 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:57,726 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:53:57,726 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:53:57,727 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,727 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,728 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:57,728 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:57,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:57,729 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:57,729 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:57,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:57,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,730 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,730 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-04-09 15:53:57,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:57,730 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:53:57,730 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:57,731 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:53:57,733 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:57,733 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:57,733 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:57,733 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. started... 2023-04-09 15:53:57,734 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3f33dcb10aa0e9a7d71e3912baad4893 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:53:58,167 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030fbfa5fdce6746cd8ff3c6436b547582 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601030fbfa5fdce6746cd8ff3c6436b547582 2023-04-09 15:53:58,175 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/427e704f0d3d4e73924dab4f203768d3 2023-04-09 15:53:58,184 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/427e704f0d3d4e73924dab4f203768d3 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/427e704f0d3d4e73924dab4f203768d3 2023-04-09 15:53:58,190 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/427e704f0d3d4e73924dab4f203768d3, entries=1, sequenceid=33, filesize=4.9 K 2023-04-09 15:53:58,191 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3f33dcb10aa0e9a7d71e3912baad4893 in 457ms, sequenceid=33, compaction requested=true 2023-04-09 15:53:58,192 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3f33dcb10aa0e9a7d71e3912baad4893: 2023-04-09 15:53:58,192 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:58,192 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:58,192 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:58,192 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,192 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:53:58,192 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:53:58,193 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,193 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:58,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:58,194 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,194 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:58,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:58,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:58,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:58,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:53:58,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1388db3b[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:58,196 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:53:58,196 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,197 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,197 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,197 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:58,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,197 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:53:58,197 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:53:58,198 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:58,202 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,202 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:53:58,202 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:58,202 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:53:58,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:58,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:58,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:58,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:58,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:58,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:53:58,209 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:53:58,209 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:58,210 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:58,210 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,210 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:58,212 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,212 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:58,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:58,213 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:58,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:58,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:58,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:58,213 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,216 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,220 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:58,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:58,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:58,221 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,221 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:58,221 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:58,221 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:58,221 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:58,221 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,221 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,221 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,221 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,221 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,221 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:58,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:58,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:58,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:58,321 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:58,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:58,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:58,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:53:58,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,331 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:58,332 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:58,332 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:53:58,332 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:53:58,332 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,332 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,334 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,334 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:58,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:58,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:58,334 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,334 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:58,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:58,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,335 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,335 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-04-09 15:53:58,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,335 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:53:58,335 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:58,336 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:53:58,336 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:58,336 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:58,336 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:58,336 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. started... 2023-04-09 15:53:58,336 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3f33dcb10aa0e9a7d71e3912baad4893 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:53:58,356 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509071b9bc78b49994a729b9241fd8f3585f6 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509071b9bc78b49994a729b9241fd8f3585f6 2023-04-09 15:53:58,362 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/f3426508ce8b479884214d7e54c395ed 2023-04-09 15:53:58,369 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/f3426508ce8b479884214d7e54c395ed as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/f3426508ce8b479884214d7e54c395ed 2023-04-09 15:53:58,376 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/f3426508ce8b479884214d7e54c395ed, entries=1, sequenceid=37, filesize=4.9 K 2023-04-09 15:53:58,377 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3f33dcb10aa0e9a7d71e3912baad4893 in 41ms, sequenceid=37, compaction requested=true 2023-04-09 15:53:58,377 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3f33dcb10aa0e9a7d71e3912baad4893: 2023-04-09 15:53:58,377 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:58,377 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:58,377 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:58,377 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,377 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:53:58,377 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:53:58,380 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,380 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:58,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:58,381 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:58,381 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:58,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:58,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:58,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:53:58,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16bf67e5[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:58,383 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:53:58,383 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,384 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,384 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:53:58,384 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:53:58,384 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:58,385 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,385 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:58,386 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,386 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:53:58,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:58,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:58,387 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:58,387 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:53:58,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:58,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:58,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:58,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:58,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:53:58,391 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:53:58,391 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:58,391 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:58,391 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,391 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:58,393 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,393 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:58,393 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:58,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:58,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:58,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:58,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:58,393 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:58,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,395 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:58,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,399 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,399 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,399 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:58,399 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:58,399 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:58,399 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:58,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:58,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:58,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:58,399 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,401 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,401 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,401 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,401 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:58,401 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:58,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:58,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:58,404 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-09 15:53:58,501 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:58,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:58,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:53:58,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:53:58,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,511 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:58,511 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:58,512 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:53:58,512 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:53:58,512 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,512 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,514 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:58,514 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:58,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:58,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,514 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,514 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:53:58,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:53:58,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,515 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,515 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-04-09 15:53:58,515 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,515 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:53:58,515 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:53:58,517 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:53:58,517 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:53:58,517 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:53:58,517 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:58,517 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. started... 2023-04-09 15:53:58,517 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3f33dcb10aa0e9a7d71e3912baad4893 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:53:58,552 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120367c2567e8ec4b42a1a2b7e2053621c2 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120367c2567e8ec4b42a1a2b7e2053621c2 2023-04-09 15:53:58,960 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/6b776ea3140d4c4188a26af3dfa077b3 2023-04-09 15:53:58,967 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/6b776ea3140d4c4188a26af3dfa077b3 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/6b776ea3140d4c4188a26af3dfa077b3 2023-04-09 15:53:58,974 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/6b776ea3140d4c4188a26af3dfa077b3, entries=1, sequenceid=41, filesize=4.9 K 2023-04-09 15:53:58,976 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3f33dcb10aa0e9a7d71e3912baad4893 in 459ms, sequenceid=41, compaction requested=true 2023-04-09 15:53:58,976 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3f33dcb10aa0e9a7d71e3912baad4893: 2023-04-09 15:53:58,976 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:58,976 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:53:58,976 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:53:58,976 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,976 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:53:58,976 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:53:58,978 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:58,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:58,978 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:58,978 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,979 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:53:58,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:58,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:58,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:53:58,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49fad212[Count = 0] remaining members to acquire global barrier 2023-04-09 15:53:58,980 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:53:58,980 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,981 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,981 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:53:58,981 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:53:58,981 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:53:58,981 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,982 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:53:58,984 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:58,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:58,984 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:53:58,985 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:58,985 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:53:58,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:58,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:58,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:58,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:53:58,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:53:58,988 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:53:58,988 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:53:58,988 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:53:58,988 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,988 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:53:58,990 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,990 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,990 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:58,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:53:58,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:53:58,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,990 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:53:58,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:58,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:58,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:53:58,992 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:53:58,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,994 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,994 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:53:58,994 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:53:58,994 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:53:58,994 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:53:58,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-04-09 15:53:58,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:53:58,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:53:58,994 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,995 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:53:58,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-09 15:53:58,995 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,996 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,996 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:58,997 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:53:58,997 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:53:58,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:53:58,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:53:59,097 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:53:59,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:53:59,100 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33617] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-04-09 15:53:59,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-04-09 15:53:59,109 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-04-09 15:53:59,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:53:59,110 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1681056239110 2023-04-09 15:53:59,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-09 15:53:59,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-04-09 15:53:59,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-04-09 15:53:59,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] zookeeper.ReadOnlyZKClient(139): Connect 0x59e92b00 to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:53:59,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62531821, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:53:59,144 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-04-09 15:53:59,238 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032800340ff6314eea948840c93706dfb9 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601032800340ff6314eea948840c93706dfb9 2023-04-09 15:53:59,239 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-04-09 15:53:59,259 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:53:59,261 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:53:59,281 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-09 15:53:59,282 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-09 15:53:59,314 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7768bd553f594c7fa1eb10c4de98139d first=Optional[r5] last=Optional[r6] 2023-04-09 15:53:59,315 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7768bd553f594c7fa1eb10c4de98139d}] 2023-04-09 15:53:59,322 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7768bd553f594c7fa1eb10c4de98139d for inclusion in 3f33dcb10aa0e9a7d71e3912baad4893/family1 2023-04-09 15:53:59,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-04-09 15:53:59,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:53:59,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for 3f33dcb10aa0e9a7d71e3912baad4893: 2023-04-09 15:53:59,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7768bd553f594c7fa1eb10c4de98139d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__pv7672vh6dt82jld2mhujtomafaaapsn97o9m9h5lttf5835n0pdro2vo20u0nt1/family1/7768bd553f594c7fa1eb10c4de98139d 2023-04-09 15:53:59,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__pv7672vh6dt82jld2mhujtomafaaapsn97o9m9h5lttf5835n0pdro2vo20u0nt1/family1/7768bd553f594c7fa1eb10c4de98139d as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/ba1448843a82495f8e5cc24211198248_SeqId_44_ 2023-04-09 15:53:59,346 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__pv7672vh6dt82jld2mhujtomafaaapsn97o9m9h5lttf5835n0pdro2vo20u0nt1/family1/7768bd553f594c7fa1eb10c4de98139d into 3f33dcb10aa0e9a7d71e3912baad4893/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/ba1448843a82495f8e5cc24211198248_SeqId_44_ - updating store file list. 2023-04-09 15:53:59,355 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/ba1448843a82495f8e5cc24211198248_SeqId_44_ into 3f33dcb10aa0e9a7d71e3912baad4893/family1 2023-04-09 15:53:59,355 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__pv7672vh6dt82jld2mhujtomafaaapsn97o9m9h5lttf5835n0pdro2vo20u0nt1/family1/7768bd553f594c7fa1eb10c4de98139d into 3f33dcb10aa0e9a7d71e3912baad4893/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/ba1448843a82495f8e5cc24211198248_SeqId_44_) 2023-04-09 15:53:59,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__pv7672vh6dt82jld2mhujtomafaaapsn97o9m9h5lttf5835n0pdro2vo20u0nt1/family1/7768bd553f594c7fa1eb10c4de98139d 2023-04-09 15:53:59,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-04-09 15:53:59,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-04-09 15:53:59,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(1912): 3f33dcb10aa0e9a7d71e3912baad4893/family1 is initiating minor compaction 2023-04-09 15:53:59,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7f3c2f54; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:53:59,364 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 3f33dcb10aa0e9a7d71e3912baad4893/family1 in testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:53:59,364 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/f4bd62ac16ab477da1a9c3bdc046a578, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/3fbc9d3761744afc961c68cdb746c009, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/18992f3ba3414f20aa9c6aa0deec4dcb, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/373ae31774a5463b806924e38e2af0c7, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/6f9acf2a3b53413980aa149b167b4e7a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/9f0874cc02d149c7937696bd62ba1547, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/427e704f0d3d4e73924dab4f203768d3, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/f3426508ce8b479884214d7e54c395ed, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/6b776ea3140d4c4188a26af3dfa077b3, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/ba1448843a82495f8e5cc24211198248_SeqId_44_] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp, totalSize=49.7 K 2023-04-09 15:53:59,364 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting f4bd62ac16ab477da1a9c3bdc046a578, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-04-09 15:53:59,364 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 3fbc9d3761744afc961c68cdb746c009, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-04-09 15:53:59,365 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 18992f3ba3414f20aa9c6aa0deec4dcb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-04-09 15:53:59,365 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 373ae31774a5463b806924e38e2af0c7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-04-09 15:53:59,365 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 6f9acf2a3b53413980aa149b167b4e7a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-04-09 15:53:59,365 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 9f0874cc02d149c7937696bd62ba1547, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-04-09 15:53:59,365 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 427e704f0d3d4e73924dab4f203768d3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-04-09 15:53:59,365 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting f3426508ce8b479884214d7e54c395ed, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-04-09 15:53:59,365 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 6b776ea3140d4c4188a26af3dfa077b3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-04-09 15:53:59,365 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting ba1448843a82495f8e5cc24211198248_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-04-09 15:53:59,367 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-04-09 15:53:59,368 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:53:59,371 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601018a6a772089e54d95b143fc3a37202d14 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601018a6a772089e54d95b143fc3a37202d14 2023-04-09 15:53:59,373 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601030fbfa5fdce6746cd8ff3c6436b547582 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601030fbfa5fdce6746cd8ff3c6436b547582 2023-04-09 15:53:59,373 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-04-09 15:53:59,373 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-04-09 15:53:59,374 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-04-09 15:53:59,374 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-04-09 15:53:59,447 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3f33dcb10aa0e9a7d71e3912baad4893#family1#compaction#22 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:53:59,463 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312c3bd385a633452990cebcc1412d990c to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512312c3bd385a633452990cebcc1412d990c 2023-04-09 15:53:59,464 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-04-09 15:53:59,517 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/76b8060a77a247d093df50d7031e5504 first=Optional[r1] last=Optional[r4] 2023-04-09 15:53:59,518 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/76b8060a77a247d093df50d7031e5504}] 2023-04-09 15:53:59,521 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/76b8060a77a247d093df50d7031e5504 for inclusion in 3f33dcb10aa0e9a7d71e3912baad4893/family1 2023-04-09 15:53:59,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-04-09 15:53:59,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:53:59,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for 3f33dcb10aa0e9a7d71e3912baad4893: 2023-04-09 15:53:59,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/76b8060a77a247d093df50d7031e5504 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3dhc4e80j4bf8f3t5n32qnel83m0mk39h8a782c9vtn91u54ucn20vj3f1s7trij/family1/76b8060a77a247d093df50d7031e5504 2023-04-09 15:53:59,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3dhc4e80j4bf8f3t5n32qnel83m0mk39h8a782c9vtn91u54ucn20vj3f1s7trij/family1/76b8060a77a247d093df50d7031e5504 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/3f01a1f9c7394b6e8bb617f0507cfb62_SeqId_46_ 2023-04-09 15:53:59,531 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3dhc4e80j4bf8f3t5n32qnel83m0mk39h8a782c9vtn91u54ucn20vj3f1s7trij/family1/76b8060a77a247d093df50d7031e5504 into 3f33dcb10aa0e9a7d71e3912baad4893/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/3f01a1f9c7394b6e8bb617f0507cfb62_SeqId_46_ - updating store file list. 2023-04-09 15:53:59,539 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/3f01a1f9c7394b6e8bb617f0507cfb62_SeqId_46_ into 3f33dcb10aa0e9a7d71e3912baad4893/family1 2023-04-09 15:53:59,539 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3dhc4e80j4bf8f3t5n32qnel83m0mk39h8a782c9vtn91u54ucn20vj3f1s7trij/family1/76b8060a77a247d093df50d7031e5504 into 3f33dcb10aa0e9a7d71e3912baad4893/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/3f01a1f9c7394b6e8bb617f0507cfb62_SeqId_46_) 2023-04-09 15:53:59,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3dhc4e80j4bf8f3t5n32qnel83m0mk39h8a782c9vtn91u54ucn20vj3f1s7trij/family1/76b8060a77a247d093df50d7031e5504 2023-04-09 15:53:59,542 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-04-09 15:53:59,543 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:53:59,544 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120139e0db627d464eabb9302c540b452160 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120139e0db627d464eabb9302c540b452160 2023-04-09 15:53:59,545 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512058238e2d5972d45e19d7d5ce9096e30d4 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512058238e2d5972d45e19d7d5ce9096e30d4 2023-04-09 15:53:59,546 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228a390422d89a843aa8d19e442243b2960 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228a390422d89a843aa8d19e442243b2960 2023-04-09 15:53:59,548 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231abf29441027744edb8d2a814a748a703 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231abf29441027744edb8d2a814a748a703 2023-04-09 15:53:59,548 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-04-09 15:53:59,548 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-04-09 15:53:59,548 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-04-09 15:53:59,549 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-04-09 15:54:00,045 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b300abc0d1a049d2915ad2d9312d45b9 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b300abc0d1a049d2915ad2d9312d45b9 2023-04-09 15:54:00,047 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-04-09 15:54:00,098 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/338c48809d72411a98ee32b27d75a571 first=Optional[r00] last=Optional[r8] 2023-04-09 15:54:00,100 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/338c48809d72411a98ee32b27d75a571}] 2023-04-09 15:54:00,103 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/338c48809d72411a98ee32b27d75a571 for inclusion in 3f33dcb10aa0e9a7d71e3912baad4893/family1 2023-04-09 15:54:00,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-04-09 15:54:00,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:54:00,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for 3f33dcb10aa0e9a7d71e3912baad4893: 2023-04-09 15:54:00,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/338c48809d72411a98ee32b27d75a571 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__678tg7p1gecsm36t4e3tmb7p06ublprftu33ro9k610177fb6jtnv57i3ekkumqj/family1/338c48809d72411a98ee32b27d75a571 2023-04-09 15:54:00,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__678tg7p1gecsm36t4e3tmb7p06ublprftu33ro9k610177fb6jtnv57i3ekkumqj/family1/338c48809d72411a98ee32b27d75a571 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/6bef954d910f4942b09024ed23bfc861_SeqId_48_ 2023-04-09 15:54:00,112 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__678tg7p1gecsm36t4e3tmb7p06ublprftu33ro9k610177fb6jtnv57i3ekkumqj/family1/338c48809d72411a98ee32b27d75a571 into 3f33dcb10aa0e9a7d71e3912baad4893/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/6bef954d910f4942b09024ed23bfc861_SeqId_48_ - updating store file list. 2023-04-09 15:54:00,128 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/6bef954d910f4942b09024ed23bfc861_SeqId_48_ into 3f33dcb10aa0e9a7d71e3912baad4893/family1 2023-04-09 15:54:00,128 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__678tg7p1gecsm36t4e3tmb7p06ublprftu33ro9k610177fb6jtnv57i3ekkumqj/family1/338c48809d72411a98ee32b27d75a571 into 3f33dcb10aa0e9a7d71e3912baad4893/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/6bef954d910f4942b09024ed23bfc861_SeqId_48_) 2023-04-09 15:54:00,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__678tg7p1gecsm36t4e3tmb7p06ublprftu33ro9k610177fb6jtnv57i3ekkumqj/family1/338c48809d72411a98ee32b27d75a571 2023-04-09 15:54:00,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.SortedCompactionPolicy(75): Selecting compaction from 13 store files, 10 compacting, 2 eligible, 16 blocking 2023-04-09 15:54:00,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-04-09 15:54:00,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-04-09 15:54:00,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.CompactSplit(415): Not compacting testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. because compaction request was cancelled 2023-04-09 15:54:00,150 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-04-09 15:54:00,152 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:00,154 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120367c2567e8ec4b42a1a2b7e2053621c2 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120367c2567e8ec4b42a1a2b7e2053621c2 2023-04-09 15:54:00,155 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128f935689dd8c84cc88e44ab6b1df9dadf to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128f935689dd8c84cc88e44ab6b1df9dadf 2023-04-09 15:54:00,156 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130ea6130baef6c4c2eb438295655d9e912 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130ea6130baef6c4c2eb438295655d9e912 2023-04-09 15:54:00,157 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-04-09 15:54:00,157 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-04-09 15:54:00,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-04-09 15:54:00,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-04-09 15:54:00,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-04-09 15:54:00,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-04-09 15:54:00,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:00,159 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-04-09 15:54:00,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.0580 sec 2023-04-09 15:54:00,276 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/.tmp/family1/c2a3c4fce7bb42798f8d5b32637172dd as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/c2a3c4fce7bb42798f8d5b32637172dd 2023-04-09 15:54:00,287 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 3f33dcb10aa0e9a7d71e3912baad4893/family1 of 3f33dcb10aa0e9a7d71e3912baad4893 into c2a3c4fce7bb42798f8d5b32637172dd(size=6.6 K), total size for store is 344.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:54:00,287 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3f33dcb10aa0e9a7d71e3912baad4893: 2023-04-09 15:54:00,288 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1681055639364; duration=0sec 2023-04-09 15:54:00,288 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:00,321 INFO [Listener at localhost/39283] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=265 (was 253) Potentially hanging thread: hconnection-0x37dcbcb6-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:53546 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:53584 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x37dcbcb6-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55034 [Waiting for operation #20] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64813@0x59e92b00 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/2122450043.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:53598 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:53610 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:53520 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1780325809_15 at /127.0.0.1:53614 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:53622 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55300 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x37dcbcb6-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64813@0x59e92b00-SendThread(127.0.0.1:64813) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1780325809_15 at /127.0.0.1:53530 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/cluster_6f150c66-096a-4a5e-360e-e20deca6fb86/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:53486 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:53480 [Waiting for operation #20] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:53570 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b42ca1a-shared-pool-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64813@0x59e92b00-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x37dcbcb6-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:53556 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:53534 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x37dcbcb6-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55156 [Waiting for operation #21] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b42ca1a-shared-pool-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x37dcbcb6-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b42ca1a-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:53654 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x37dcbcb6-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55094 [Waiting for operation #37] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55262 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:53544 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/cluster_6f150c66-096a-4a5e-360e-e20deca6fb86/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1129073969_15 at /127.0.0.1:55190 [Waiting for operation #24] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=635 (was 606) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=358 (was 317) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=1889 (was 2051) 2023-04-09 15:54:00,342 INFO [Listener at localhost/39283] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=265, OpenFileDescriptor=635, MaxFileDescriptor=60000, SystemLoadAverage=358, ProcessCount=169, AvailableMemoryMB=1888 2023-04-09 15:54:00,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-04-09 15:54:00,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:00,353 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-04-09 15:54:00,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-04-09 15:54:00,360 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-09 15:54:00,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/f4bd62ac16ab477da1a9c3bdc046a578, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/3fbc9d3761744afc961c68cdb746c009, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/18992f3ba3414f20aa9c6aa0deec4dcb, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/373ae31774a5463b806924e38e2af0c7, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/6f9acf2a3b53413980aa149b167b4e7a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/9f0874cc02d149c7937696bd62ba1547, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/427e704f0d3d4e73924dab4f203768d3, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/f3426508ce8b479884214d7e54c395ed, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/6b776ea3140d4c4188a26af3dfa077b3, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/ba1448843a82495f8e5cc24211198248_SeqId_44_] to archive 2023-04-09 15:54:00,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-04-09 15:54:00,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:00,362 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399 2023-04-09 15:54:00,363 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399 empty. 2023-04-09 15:54:00,364 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399 2023-04-09 15:54:00,364 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-04-09 15:54:00,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/f4bd62ac16ab477da1a9c3bdc046a578 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/f4bd62ac16ab477da1a9c3bdc046a578 2023-04-09 15:54:00,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/3fbc9d3761744afc961c68cdb746c009 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/3fbc9d3761744afc961c68cdb746c009 2023-04-09 15:54:00,375 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/18992f3ba3414f20aa9c6aa0deec4dcb to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/18992f3ba3414f20aa9c6aa0deec4dcb 2023-04-09 15:54:00,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/373ae31774a5463b806924e38e2af0c7 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/373ae31774a5463b806924e38e2af0c7 2023-04-09 15:54:00,379 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-04-09 15:54:00,380 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/6f9acf2a3b53413980aa149b167b4e7a to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/6f9acf2a3b53413980aa149b167b4e7a 2023-04-09 15:54:00,382 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/9f0874cc02d149c7937696bd62ba1547 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/9f0874cc02d149c7937696bd62ba1547 2023-04-09 15:54:00,384 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/427e704f0d3d4e73924dab4f203768d3 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/427e704f0d3d4e73924dab4f203768d3 2023-04-09 15:54:00,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/f3426508ce8b479884214d7e54c395ed to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/f3426508ce8b479884214d7e54c395ed 2023-04-09 15:54:00,387 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/6b776ea3140d4c4188a26af3dfa077b3 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/6b776ea3140d4c4188a26af3dfa077b3 2023-04-09 15:54:00,389 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => b269a97a2863221f6ae6fdd6f4d5f399, NAME => 'testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:54:00,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/ba1448843a82495f8e5cc24211198248_SeqId_44_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/family1/ba1448843a82495f8e5cc24211198248_SeqId_44_ 2023-04-09 15:54:00,405 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:00,405 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing b269a97a2863221f6ae6fdd6f4d5f399, disabling compactions & flushes 2023-04-09 15:54:00,405 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:00,406 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:00,406 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. after waiting 0 ms 2023-04-09 15:54:00,406 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:00,407 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:00,407 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for b269a97a2863221f6ae6fdd6f4d5f399: 2023-04-09 15:54:00,416 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-04-09 15:54:00,417 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1681055640417"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055640417"}]},"ts":"1681055640417"} 2023-04-09 15:54:00,419 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-04-09 15:54:00,420 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-09 15:54:00,420 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055640420"}]},"ts":"1681055640420"} 2023-04-09 15:54:00,422 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-04-09 15:54:00,430 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=b269a97a2863221f6ae6fdd6f4d5f399, ASSIGN}] 2023-04-09 15:54:00,432 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=b269a97a2863221f6ae6fdd6f4d5f399, ASSIGN 2023-04-09 15:54:00,433 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=b269a97a2863221f6ae6fdd6f4d5f399, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:54:00,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-04-09 15:54:00,584 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=b269a97a2863221f6ae6fdd6f4d5f399, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:00,584 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1681055640584"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055640584"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055640584"}]},"ts":"1681055640584"} 2023-04-09 15:54:00,587 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure b269a97a2863221f6ae6fdd6f4d5f399, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:00,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-04-09 15:54:00,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:00,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b269a97a2863221f6ae6fdd6f4d5f399, NAME => 'testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399.', STARTKEY => '', ENDKEY => ''} 2023-04-09 15:54:00,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy b269a97a2863221f6ae6fdd6f4d5f399 2023-04-09 15:54:00,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:00,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b269a97a2863221f6ae6fdd6f4d5f399 2023-04-09 15:54:00,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b269a97a2863221f6ae6fdd6f4d5f399 2023-04-09 15:54:00,753 INFO [StoreOpener-b269a97a2863221f6ae6fdd6f4d5f399-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b269a97a2863221f6ae6fdd6f4d5f399 2023-04-09 15:54:00,758 DEBUG [StoreOpener-b269a97a2863221f6ae6fdd6f4d5f399-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1 2023-04-09 15:54:00,758 DEBUG [StoreOpener-b269a97a2863221f6ae6fdd6f4d5f399-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1 2023-04-09 15:54:00,759 INFO [StoreOpener-b269a97a2863221f6ae6fdd6f4d5f399-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b269a97a2863221f6ae6fdd6f4d5f399 columnFamilyName family1 2023-04-09 15:54:00,763 INFO [StoreOpener-b269a97a2863221f6ae6fdd6f4d5f399-1] regionserver.HStore(310): Store=b269a97a2863221f6ae6fdd6f4d5f399/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:00,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399 2023-04-09 15:54:00,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399 2023-04-09 15:54:00,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b269a97a2863221f6ae6fdd6f4d5f399 2023-04-09 15:54:00,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:54:00,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b269a97a2863221f6ae6fdd6f4d5f399; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64376338, jitterRate=-0.04071781039237976}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-09 15:54:00,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b269a97a2863221f6ae6fdd6f4d5f399: 2023-04-09 15:54:00,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399., pid=25, masterSystemTime=1681055640741 2023-04-09 15:54:00,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:00,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:00,778 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=b269a97a2863221f6ae6fdd6f4d5f399, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:00,778 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1681055640778"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055640778"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055640778"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055640778"}]},"ts":"1681055640778"} 2023-04-09 15:54:00,788 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-04-09 15:54:00,788 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure b269a97a2863221f6ae6fdd6f4d5f399, server=jenkins-hbase4.apache.org,44869,1681055618167 in 198 msec 2023-04-09 15:54:00,791 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-04-09 15:54:00,791 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=b269a97a2863221f6ae6fdd6f4d5f399, ASSIGN in 358 msec 2023-04-09 15:54:00,792 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-09 15:54:00,792 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055640792"}]},"ts":"1681055640792"} 2023-04-09 15:54:00,794 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-04-09 15:54:00,797 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-04-09 15:54:00,801 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 453 msec 2023-04-09 15:54:00,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-04-09 15:54:00,965 INFO [Listener at localhost/39283] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-04-09 15:54:01,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:01,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,010 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:01,010 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:01,010 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:01,010 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:01,011 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,011 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,013 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:01,013 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:01,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:01,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:01,013 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:01,013 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:01,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,014 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:01,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,014 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,014 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,015 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:01,015 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:01,015 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:01,015 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:01,015 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:01,015 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:01,015 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. started... 2023-04-09 15:54:01,016 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b269a97a2863221f6ae6fdd6f4d5f399 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-04-09 15:54:01,448 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e20ff30ad27a45478080c2d03e1c0eb6 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130e20ff30ad27a45478080c2d03e1c0eb6 2023-04-09 15:54:01,855 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/85624bf8ed4145adb1c99f00b25274ad 2023-04-09 15:54:01,861 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/85624bf8ed4145adb1c99f00b25274ad as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/85624bf8ed4145adb1c99f00b25274ad 2023-04-09 15:54:01,867 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/85624bf8ed4145adb1c99f00b25274ad, entries=1000, sequenceid=5, filesize=165.1 K 2023-04-09 15:54:01,868 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for b269a97a2863221f6ae6fdd6f4d5f399 in 852ms, sequenceid=5, compaction requested=false 2023-04-09 15:54:01,869 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:01,869 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b269a97a2863221f6ae6fdd6f4d5f399: 2023-04-09 15:54:01,870 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:01,870 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:01,870 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:01,870 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:01,870 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:01,870 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:01,872 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:01,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:01,872 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:01,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:01,872 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,872 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:01,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:01,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:01,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:01,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:01,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:01,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54421511[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:01,874 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:01,874 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,875 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,875 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:01,875 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:01,875 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:01,875 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:01,875 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:01,877 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:01,877 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:01,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:01,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:01,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:01,877 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:01,877 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:01,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:01,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:01,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:01,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:01,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:01,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:01,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:01,880 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:01,880 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:01,880 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:01,880 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,880 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:01,884 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,884 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:01,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:01,884 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:01,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:01,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:01,885 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:01,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:01,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:01,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,886 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:01,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:01,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:01,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:01,889 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:01,889 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:01,889 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:01,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:01,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:01,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:01,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:01,889 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:01,889 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,890 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,890 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:01,890 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:01,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:01,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:01,890 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-09 15:54:01,890 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,890 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:01,890 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,890 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,990 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:01,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:01,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:01,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:01,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,998 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:01,999 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:01,999 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:01,999 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:01,999 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:01,999 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,001 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:02,001 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:02,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:02,001 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,001 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:02,002 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:02,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,002 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,003 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-04-09 15:54:02,003 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,003 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:02,003 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:02,003 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:02,003 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:02,003 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:02,003 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:02,003 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. started... 2023-04-09 15:54:02,004 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b269a97a2863221f6ae6fdd6f4d5f399 1/1 column families, dataSize=74 B heapSize=408 B 2023-04-09 15:54:02,038 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285d465afafccc4d668c973df198d60ac4 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511285d465afafccc4d668c973df198d60ac4 2023-04-09 15:54:02,462 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/3dcc646beda2458daea289eae3895229 2023-04-09 15:54:02,470 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/3dcc646beda2458daea289eae3895229 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/3dcc646beda2458daea289eae3895229 2023-04-09 15:54:02,481 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/3dcc646beda2458daea289eae3895229, entries=1, sequenceid=9, filesize=5.0 K 2023-04-09 15:54:02,482 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for b269a97a2863221f6ae6fdd6f4d5f399 in 478ms, sequenceid=9, compaction requested=false 2023-04-09 15:54:02,483 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b269a97a2863221f6ae6fdd6f4d5f399: 2023-04-09 15:54:02,483 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:02,483 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:02,483 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:02,483 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,483 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:02,483 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:02,485 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:02,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:02,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:02,486 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:02,487 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,487 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:02,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:02,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:02,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c65da1[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:02,488 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:02,488 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,491 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,491 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,491 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:02,491 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:02,491 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:02,491 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:02,493 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:02,493 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:02,493 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,493 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:02,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:02,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:02,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:02,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:02,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:02,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:02,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:02,497 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:02,497 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:02,497 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:02,497 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,497 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:02,502 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,502 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,502 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:02,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:02,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:02,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:02,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:02,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:02,503 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:02,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,505 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:02,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,509 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:02,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:02,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:02,509 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:02,510 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:02,510 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,510 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,510 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,510 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,510 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,510 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,510 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,510 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:02,510 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:02,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:02,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:02,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:02,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:02,610 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:02,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:02,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:02,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:02,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,618 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:02,618 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:02,618 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:02,618 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:02,619 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,619 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,621 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,621 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:02,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:02,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:02,622 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:02,622 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:02,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,622 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:02,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,623 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,623 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-04-09 15:54:02,623 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:02,623 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:02,623 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:02,623 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:02,623 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:02,623 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:02,623 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:02,623 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. started... 2023-04-09 15:54:02,624 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b269a97a2863221f6ae6fdd6f4d5f399 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:03,043 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120167c3839e280748f1b56792cf4459df6c to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120167c3839e280748f1b56792cf4459df6c 2023-04-09 15:54:03,052 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/e3d5f44ad6a4456d87536509b208dcd2 2023-04-09 15:54:03,058 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/e3d5f44ad6a4456d87536509b208dcd2 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/e3d5f44ad6a4456d87536509b208dcd2 2023-04-09 15:54:03,065 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/e3d5f44ad6a4456d87536509b208dcd2, entries=1, sequenceid=13, filesize=4.9 K 2023-04-09 15:54:03,067 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b269a97a2863221f6ae6fdd6f4d5f399 in 443ms, sequenceid=13, compaction requested=true 2023-04-09 15:54:03,067 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b269a97a2863221f6ae6fdd6f4d5f399: 2023-04-09 15:54:03,067 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:03,067 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:03,067 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:03,067 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,067 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:03,067 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:03,069 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,069 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:03,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:03,070 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,070 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:03,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:03,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:03,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:03,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:03,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c2b9233[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:03,072 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:03,072 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,076 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,076 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:03,076 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:03,076 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,076 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:03,076 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:03,080 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:03,080 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,080 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:03,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:03,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:03,080 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:03,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:03,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:03,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:03,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:03,084 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:03,084 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:03,084 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:03,084 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,084 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:03,086 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,086 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:03,086 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:03,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:03,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:03,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:03,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:03,087 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:03,089 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:03,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,095 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,095 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,095 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:03,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:03,095 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,095 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,095 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,095 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,095 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:03,095 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:03,095 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:03,095 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:03,095 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:03,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-09 15:54:03,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:03,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:03,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:03,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:03,196 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:03,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:03,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:03,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:03,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,213 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:03,213 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:03,213 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:03,213 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:03,214 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,214 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,215 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,215 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:03,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:03,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:03,215 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,216 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,217 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,217 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-04-09 15:54:03,217 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,217 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:03,217 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:03,217 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:03,217 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:03,217 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:03,217 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:03,217 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. started... 2023-04-09 15:54:03,217 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b269a97a2863221f6ae6fdd6f4d5f399 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:03,235 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512059a2e655136cf4534a6d47c1bcd26cbf6 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512059a2e655136cf4534a6d47c1bcd26cbf6 2023-04-09 15:54:03,241 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/33f48d41f2754ac2829da7263f46880f 2023-04-09 15:54:03,248 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/33f48d41f2754ac2829da7263f46880f as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/33f48d41f2754ac2829da7263f46880f 2023-04-09 15:54:03,253 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/33f48d41f2754ac2829da7263f46880f, entries=1, sequenceid=17, filesize=4.9 K 2023-04-09 15:54:03,254 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b269a97a2863221f6ae6fdd6f4d5f399 in 37ms, sequenceid=17, compaction requested=true 2023-04-09 15:54:03,254 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b269a97a2863221f6ae6fdd6f4d5f399: 2023-04-09 15:54:03,254 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:03,255 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:03,255 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:03,255 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,255 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:03,255 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:03,257 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,257 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:03,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:03,257 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,257 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:03,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:03,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:03,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:03,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:03,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@735eb7e6[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:03,259 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:03,259 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,261 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,262 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:03,262 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,262 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:03,262 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:03,262 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:03,263 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:03,264 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:03,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:03,264 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:03,264 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:03,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:03,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:03,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:03,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:03,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:03,267 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:03,267 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:03,267 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:03,267 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,267 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:03,269 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,269 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:03,269 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:03,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:03,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:03,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:03,269 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:03,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:03,271 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:03,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,278 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:03,278 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,278 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:03,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:03,278 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:03,278 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:03,279 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:03,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-09 15:54:03,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:03,278 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,278 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:03,279 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,279 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:03,279 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,279 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:03,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:03,379 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:03,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:03,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:03,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:03,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,388 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:03,388 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:03,388 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:03,388 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:03,388 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,388 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,391 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:03,391 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:03,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:03,391 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,391 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:03,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:03,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,392 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,393 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-04-09 15:54:03,393 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,393 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:03,393 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:03,393 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:03,393 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:03,393 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:03,393 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:03,393 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. started... 2023-04-09 15:54:03,394 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b269a97a2863221f6ae6fdd6f4d5f399 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:03,414 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512286db3e4d94d364a04a7a9f89dad2ccfc2 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512286db3e4d94d364a04a7a9f89dad2ccfc2 2023-04-09 15:54:03,422 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/a8a4e58af63441498a1687799e2ee558 2023-04-09 15:54:03,429 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/a8a4e58af63441498a1687799e2ee558 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/a8a4e58af63441498a1687799e2ee558 2023-04-09 15:54:03,434 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/a8a4e58af63441498a1687799e2ee558, entries=1, sequenceid=21, filesize=4.9 K 2023-04-09 15:54:03,435 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b269a97a2863221f6ae6fdd6f4d5f399 in 41ms, sequenceid=21, compaction requested=true 2023-04-09 15:54:03,435 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b269a97a2863221f6ae6fdd6f4d5f399: 2023-04-09 15:54:03,435 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:03,436 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:03,436 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:03,436 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,436 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:03,436 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:03,437 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,437 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:03,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:03,438 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,438 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:03,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:03,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:03,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:03,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:03,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3770ce01[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:03,440 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:03,440 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,441 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,441 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:03,441 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:03,441 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:03,442 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,442 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:03,443 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:03,443 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:03,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:03,443 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:03,444 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:03,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:03,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:03,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:03,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:03,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:03,448 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:03,448 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:03,448 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:03,449 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,449 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:03,451 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,451 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:03,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:03,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,451 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:03,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:03,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:03,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:03,453 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:03,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,455 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:03,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,458 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:03,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:03,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:03,458 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:03,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:03,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:03,459 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:03,459 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,459 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:03,459 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:03,459 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,459 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,459 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,459 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,459 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,459 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:03,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-09 15:54:03,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:03,560 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:03,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:03,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:03,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:03,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,570 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:03,570 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:03,570 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:03,570 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:03,570 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,570 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,571 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:03,571 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:03,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:03,572 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,572 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:03,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:03,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,573 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,573 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-04-09 15:54:03,573 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,573 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:03,573 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:03,574 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:03,574 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:03,574 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:03,574 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:03,574 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. started... 2023-04-09 15:54:03,574 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b269a97a2863221f6ae6fdd6f4d5f399 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:03,612 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123102fc75c974a14fbcaabb3b789015b7cd to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123102fc75c974a14fbcaabb3b789015b7cd 2023-04-09 15:54:03,625 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/ec48a0a0b5f646319898fe084d5ae12d 2023-04-09 15:54:03,635 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/ec48a0a0b5f646319898fe084d5ae12d as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/ec48a0a0b5f646319898fe084d5ae12d 2023-04-09 15:54:03,652 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/ec48a0a0b5f646319898fe084d5ae12d, entries=1, sequenceid=25, filesize=4.9 K 2023-04-09 15:54:03,653 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b269a97a2863221f6ae6fdd6f4d5f399 in 79ms, sequenceid=25, compaction requested=true 2023-04-09 15:54:03,654 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b269a97a2863221f6ae6fdd6f4d5f399: 2023-04-09 15:54:03,654 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:03,654 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:03,654 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:03,654 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,654 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:03,654 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:03,657 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,657 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:03,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:03,700 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-09 15:54:03,700 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59e92b00 to 127.0.0.1:64813 2023-04-09 15:54:03,700 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:54:03,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:03,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:03,701 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-09 15:54:03,701 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d0351aa to 127.0.0.1:64813 2023-04-09 15:54:03,701 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:54:03,702 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-09 15:54:03,702 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ba5e869 to 127.0.0.1:64813 2023-04-09 15:54:03,702 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:54:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,706 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,706 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:03,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:03,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:03,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@468a61b[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:03,708 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:03,708 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,710 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,710 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,710 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:03,710 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:03,710 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:03,710 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:03,714 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:03,715 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:03,715 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:03,715 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:03,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:03,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:03,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:03,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:03,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:03,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:03,719 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:03,719 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:03,719 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:03,719 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,719 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:03,721 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,721 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,721 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:03,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:03,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:03,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:03,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:03,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:03,722 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:03,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,724 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:03,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,727 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:03,727 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:03,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:03,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:03,727 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,727 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,727 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:03,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:03,727 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:03,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:03,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:03,728 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:03,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-09 15:54:03,727 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,728 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:03,728 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,728 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,729 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,828 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:03,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:03,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:03,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:03,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,836 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:03,836 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:03,836 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:03,836 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:03,837 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,837 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,838 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,838 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:03,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:03,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:03,839 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,839 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:03,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,839 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:03,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,840 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,840 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-04-09 15:54:03,840 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,840 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:03,840 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:03,840 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:03,840 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:03,840 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:03,840 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:03,840 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. started... 2023-04-09 15:54:03,841 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b269a97a2863221f6ae6fdd6f4d5f399 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:03,856 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f7a72d5c7b594168a406a750179f520b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101f7a72d5c7b594168a406a750179f520b 2023-04-09 15:54:03,864 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/e81c94b7a8f1447ab2256e65de664160 2023-04-09 15:54:03,871 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/e81c94b7a8f1447ab2256e65de664160 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/e81c94b7a8f1447ab2256e65de664160 2023-04-09 15:54:03,876 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/e81c94b7a8f1447ab2256e65de664160, entries=1, sequenceid=29, filesize=4.9 K 2023-04-09 15:54:03,882 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b269a97a2863221f6ae6fdd6f4d5f399 in 41ms, sequenceid=29, compaction requested=true 2023-04-09 15:54:03,882 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b269a97a2863221f6ae6fdd6f4d5f399: 2023-04-09 15:54:03,882 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:03,882 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:03,882 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:03,882 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,882 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:03,882 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:03,885 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,885 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:03,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:03,886 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,886 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:03,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:03,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:03,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:03,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:03,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34e206af[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:03,888 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:03,888 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,889 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,889 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:03,889 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:03,889 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:03,890 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,890 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:03,891 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:03,891 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:03,891 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,891 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:03,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:03,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:03,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:03,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:03,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:03,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:03,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:03,894 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:03,894 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:03,894 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:03,894 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,894 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:03,896 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,896 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,896 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:03,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:03,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:03,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:03,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:03,897 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:03,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:03,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,899 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:03,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,904 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:03,904 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:03,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:03,904 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:03,905 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:03,904 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:03,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:03,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:03,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:03,905 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,905 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:03,905 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,905 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,905 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:03,906 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:03,906 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:04,006 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:04,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:04,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:04,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:04,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,014 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:04,014 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:04,015 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:04,015 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:04,015 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,015 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,016 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,016 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:04,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:04,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:04,017 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,017 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:04,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:04,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,018 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,018 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-04-09 15:54:04,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,018 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:04,019 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:04,019 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:04,024 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:04,024 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:04,024 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:04,024 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. started... 2023-04-09 15:54:04,024 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b269a97a2863221f6ae6fdd6f4d5f399 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:04,442 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103052c8d542a1e4ebeb4e7854596ef2603 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103052c8d542a1e4ebeb4e7854596ef2603 2023-04-09 15:54:04,453 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/2434c22cfc0345ab8d10ddbe3e2bc475 2023-04-09 15:54:04,459 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/2434c22cfc0345ab8d10ddbe3e2bc475 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/2434c22cfc0345ab8d10ddbe3e2bc475 2023-04-09 15:54:04,464 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/2434c22cfc0345ab8d10ddbe3e2bc475, entries=1, sequenceid=33, filesize=4.9 K 2023-04-09 15:54:04,466 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b269a97a2863221f6ae6fdd6f4d5f399 in 442ms, sequenceid=33, compaction requested=true 2023-04-09 15:54:04,466 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b269a97a2863221f6ae6fdd6f4d5f399: 2023-04-09 15:54:04,466 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:04,466 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:04,467 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:04,467 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,467 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:04,467 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:04,468 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,468 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:04,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:04,469 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,469 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:04,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:04,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:04,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:04,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:04,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32857652[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:04,470 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:04,470 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,472 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,472 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:04,472 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:04,472 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:04,472 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,472 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:04,474 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:04,474 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,474 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:04,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:04,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:04,475 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:04,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:04,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:04,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:04,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:04,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:04,477 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:04,477 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:04,477 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:04,477 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,477 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:04,479 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,479 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:04,479 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:04,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:04,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,479 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:04,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:04,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:04,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:04,481 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:04,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,483 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:04,483 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:04,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:04,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:04,483 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:04,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:04,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:04,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:04,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:04,484 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:04,484 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:04,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-09 15:54:04,488 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,488 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,488 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,488 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,488 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,488 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,488 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,584 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:04,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:04,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:04,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:04,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,593 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:04,593 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:04,593 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:04,593 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:04,593 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,593 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,595 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:04,595 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:04,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:04,595 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:04,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,595 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:04,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:04,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,596 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,596 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-04-09 15:54:04,596 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:04,596 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:04,596 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:04,596 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:04,597 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:04,597 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:04,597 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:04,597 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. started... 2023-04-09 15:54:04,597 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b269a97a2863221f6ae6fdd6f4d5f399 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:04,614 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ce98eeeb3a7b466484e443efaeb24526 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907ce98eeeb3a7b466484e443efaeb24526 2023-04-09 15:54:05,020 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/0a5c1a67da4d408e992e1af95614aafc 2023-04-09 15:54:05,026 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/0a5c1a67da4d408e992e1af95614aafc as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/0a5c1a67da4d408e992e1af95614aafc 2023-04-09 15:54:05,030 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/0a5c1a67da4d408e992e1af95614aafc, entries=1, sequenceid=37, filesize=4.9 K 2023-04-09 15:54:05,031 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b269a97a2863221f6ae6fdd6f4d5f399 in 434ms, sequenceid=37, compaction requested=true 2023-04-09 15:54:05,031 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b269a97a2863221f6ae6fdd6f4d5f399: 2023-04-09 15:54:05,031 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:05,031 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:05,031 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:05,031 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:05,031 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:05,031 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:05,034 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:05,034 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:05,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:05,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:05,034 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,034 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:05,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:05,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:05,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:05,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:05,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:05,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b4b6c5[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:05,036 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:05,036 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,044 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,044 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:05,045 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:05,044 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:05,045 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:05,045 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:05,046 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:05,046 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:05,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:05,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:05,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:05,046 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:05,046 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:05,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:05,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:05,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:05,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:05,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:05,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:05,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:05,048 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:05,048 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:05,048 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:05,048 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,048 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:05,055 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,055 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:05,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:05,055 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:05,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:05,055 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:05,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:05,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:05,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:05,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,056 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:05,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:05,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:05,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:05,058 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:05,058 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:05,058 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:05,058 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-09 15:54:05,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:05,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:05,058 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,058 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:05,058 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:05,059 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:05,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:05,059 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:05,059 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:05,059 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,059 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,059 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:05,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:05,159 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:05,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:05,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:05,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:05,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,166 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:05,166 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:05,166 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:05,166 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:05,166 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,167 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,168 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:05,168 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:05,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:05,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:05,168 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:05,168 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:05,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:05,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,169 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,169 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-04-09 15:54:05,169 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:05,169 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:05,169 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:05,169 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:05,169 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:05,169 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:05,170 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:05,170 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. started... 2023-04-09 15:54:05,170 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b269a97a2863221f6ae6fdd6f4d5f399 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:05,586 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511205c90ff261d1d4c01b2574899c958cc84 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511205c90ff261d1d4c01b2574899c958cc84 2023-04-09 15:54:05,992 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/809381a526c647bc8f2100bde3e28535 2023-04-09 15:54:05,998 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/809381a526c647bc8f2100bde3e28535 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/809381a526c647bc8f2100bde3e28535 2023-04-09 15:54:06,002 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/809381a526c647bc8f2100bde3e28535, entries=1, sequenceid=41, filesize=4.9 K 2023-04-09 15:54:06,003 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b269a97a2863221f6ae6fdd6f4d5f399 in 833ms, sequenceid=41, compaction requested=true 2023-04-09 15:54:06,003 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b269a97a2863221f6ae6fdd6f4d5f399: 2023-04-09 15:54:06,003 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:06,003 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:06,003 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:06,003 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:06,003 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:06,003 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:06,005 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,005 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:06,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:06,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:06,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:06,005 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,005 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:06,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:06,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:06,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:06,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:06,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:06,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@422d90d6[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:06,007 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:06,007 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,009 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,009 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:06,009 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:06,009 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:06,009 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:06,009 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:06,010 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:06,010 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:06,011 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:06,011 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:06,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:06,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:06,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:06,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:06,013 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:06,013 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:06,013 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:06,013 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,013 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:06,014 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,014 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,014 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:06,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:06,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:06,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:06,015 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:06,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:06,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:06,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:06,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,016 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:06,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:06,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:06,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:06,018 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:06,018 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:06,018 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:06,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-09 15:54:06,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:06,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-04-09 15:54:06,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:06,018 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:06,018 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,018 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:06,018 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:06,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:06,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:06,018 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,018 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:06,019 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:06,018 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,019 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,119 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:06,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:06,121 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33617] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-04-09 15:54:06,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-04-09 15:54:06,123 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-04-09 15:54:06,124 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:06,124 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1681056246124 2023-04-09 15:54:06,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-04-09 15:54:06,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-04-09 15:54:06,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-04-09 15:54:06,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] zookeeper.ReadOnlyZKClient(139): Connect 0x49c0d4d3 to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:54:06,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33284fda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:54:06,136 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:06,248 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-09 15:54:06,976 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010356661484f1f2493bbe5c85994a43a385 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010356661484f1f2493bbe5c85994a43a385 2023-04-09 15:54:06,977 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-04-09 15:54:06,990 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:54:06,991 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53858, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:54:06,997 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-09 15:54:06,999 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-09 15:54:07,008 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/817b51c572214957aee1b55aad2d2e88 first=Optional[r3] last=Optional[r6] 2023-04-09 15:54:07,009 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/817b51c572214957aee1b55aad2d2e88}] 2023-04-09 15:54:07,014 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/817b51c572214957aee1b55aad2d2e88 for inclusion in b269a97a2863221f6ae6fdd6f4d5f399/family1 2023-04-09 15:54:07,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-04-09 15:54:07,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:54:07,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for b269a97a2863221f6ae6fdd6f4d5f399: 2023-04-09 15:54:07,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/817b51c572214957aee1b55aad2d2e88 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8r4nmf71ai72nosrhllnvg0921i224u9a305grssk9fd3qpnrp82g0l4sn5udfhl/family1/817b51c572214957aee1b55aad2d2e88 2023-04-09 15:54:07,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8r4nmf71ai72nosrhllnvg0921i224u9a305grssk9fd3qpnrp82g0l4sn5udfhl/family1/817b51c572214957aee1b55aad2d2e88 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/fa1ba25fb83a48e88c79c2b6b94ff629_SeqId_44_ 2023-04-09 15:54:07,021 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8r4nmf71ai72nosrhllnvg0921i224u9a305grssk9fd3qpnrp82g0l4sn5udfhl/family1/817b51c572214957aee1b55aad2d2e88 into b269a97a2863221f6ae6fdd6f4d5f399/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/fa1ba25fb83a48e88c79c2b6b94ff629_SeqId_44_ - updating store file list. 2023-04-09 15:54:07,026 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/fa1ba25fb83a48e88c79c2b6b94ff629_SeqId_44_ into b269a97a2863221f6ae6fdd6f4d5f399/family1 2023-04-09 15:54:07,026 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8r4nmf71ai72nosrhllnvg0921i224u9a305grssk9fd3qpnrp82g0l4sn5udfhl/family1/817b51c572214957aee1b55aad2d2e88 into b269a97a2863221f6ae6fdd6f4d5f399/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/fa1ba25fb83a48e88c79c2b6b94ff629_SeqId_44_) 2023-04-09 15:54:07,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8r4nmf71ai72nosrhllnvg0921i224u9a305grssk9fd3qpnrp82g0l4sn5udfhl/family1/817b51c572214957aee1b55aad2d2e88 2023-04-09 15:54:07,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-04-09 15:54:07,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-04-09 15:54:07,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(1912): b269a97a2863221f6ae6fdd6f4d5f399/family1 is initiating minor compaction 2023-04-09 15:54:07,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@60e9bf80; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:07,030 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b269a97a2863221f6ae6fdd6f4d5f399/family1 in testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:07,030 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/3dcc646beda2458daea289eae3895229, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/e3d5f44ad6a4456d87536509b208dcd2, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/33f48d41f2754ac2829da7263f46880f, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/a8a4e58af63441498a1687799e2ee558, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/ec48a0a0b5f646319898fe084d5ae12d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/e81c94b7a8f1447ab2256e65de664160, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/2434c22cfc0345ab8d10ddbe3e2bc475, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/0a5c1a67da4d408e992e1af95614aafc, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/809381a526c647bc8f2100bde3e28535, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/fa1ba25fb83a48e88c79c2b6b94ff629_SeqId_44_] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp, totalSize=50.0 K 2023-04-09 15:54:07,031 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 3dcc646beda2458daea289eae3895229, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-04-09 15:54:07,031 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting e3d5f44ad6a4456d87536509b208dcd2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-04-09 15:54:07,031 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 33f48d41f2754ac2829da7263f46880f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-04-09 15:54:07,031 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting a8a4e58af63441498a1687799e2ee558, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-04-09 15:54:07,031 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting ec48a0a0b5f646319898fe084d5ae12d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-04-09 15:54:07,031 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting e81c94b7a8f1447ab2256e65de664160, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-04-09 15:54:07,031 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 2434c22cfc0345ab8d10ddbe3e2bc475, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-04-09 15:54:07,031 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 0a5c1a67da4d408e992e1af95614aafc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-04-09 15:54:07,031 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 809381a526c647bc8f2100bde3e28535, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-04-09 15:54:07,031 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting fa1ba25fb83a48e88c79c2b6b94ff629_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-04-09 15:54:07,032 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-04-09 15:54:07,033 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:07,035 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512286db3e4d94d364a04a7a9f89dad2ccfc2 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512286db3e4d94d364a04a7a9f89dad2ccfc2 2023-04-09 15:54:07,036 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123102fc75c974a14fbcaabb3b789015b7cd to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123102fc75c974a14fbcaabb3b789015b7cd 2023-04-09 15:54:07,038 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101f7a72d5c7b594168a406a750179f520b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101f7a72d5c7b594168a406a750179f520b 2023-04-09 15:54:07,039 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103052c8d542a1e4ebeb4e7854596ef2603 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103052c8d542a1e4ebeb4e7854596ef2603 2023-04-09 15:54:07,039 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-04-09 15:54:07,039 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-04-09 15:54:07,040 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:07,040 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:07,040 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:07,040 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:07,040 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:07,040 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:07,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:07,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:07,060 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] throttle.PressureAwareThroughputController(145): b269a97a2863221f6ae6fdd6f4d5f399#family1#compaction#33 average throughput is 1.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:54:07,878 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ce8a14656ae248c2a5e6721231d08365 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ce8a14656ae248c2a5e6721231d08365 2023-04-09 15:54:07,879 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/f0a058255b1c46ba9e35d339aeeaa4d4 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/f0a058255b1c46ba9e35d339aeeaa4d4 2023-04-09 15:54:07,879 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-04-09 15:54:07,885 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in b269a97a2863221f6ae6fdd6f4d5f399/family1 of b269a97a2863221f6ae6fdd6f4d5f399 into f0a058255b1c46ba9e35d339aeeaa4d4(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:54:07,885 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b269a97a2863221f6ae6fdd6f4d5f399: 2023-04-09 15:54:07,885 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1681055647030; duration=0sec 2023-04-09 15:54:07,885 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:07,906 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a73a2cabe40e4798aff7f7a742ded125 first=Optional[r1] last=Optional[r2] 2023-04-09 15:54:07,907 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a73a2cabe40e4798aff7f7a742ded125}] 2023-04-09 15:54:07,910 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a73a2cabe40e4798aff7f7a742ded125 for inclusion in b269a97a2863221f6ae6fdd6f4d5f399/family1 2023-04-09 15:54:07,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-04-09 15:54:07,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:54:07,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for b269a97a2863221f6ae6fdd6f4d5f399: 2023-04-09 15:54:07,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a73a2cabe40e4798aff7f7a742ded125 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fii5dohpmfrsv2pavabosqgfumuqdard9tdq7dtsbetnr1htg5hnchvlqo6g5vfv/family1/a73a2cabe40e4798aff7f7a742ded125 2023-04-09 15:54:07,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fii5dohpmfrsv2pavabosqgfumuqdard9tdq7dtsbetnr1htg5hnchvlqo6g5vfv/family1/a73a2cabe40e4798aff7f7a742ded125 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/f1266c71df54430bb3eaa7f11f4bcd05_SeqId_47_ 2023-04-09 15:54:07,916 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fii5dohpmfrsv2pavabosqgfumuqdard9tdq7dtsbetnr1htg5hnchvlqo6g5vfv/family1/a73a2cabe40e4798aff7f7a742ded125 into b269a97a2863221f6ae6fdd6f4d5f399/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/f1266c71df54430bb3eaa7f11f4bcd05_SeqId_47_ - updating store file list. 2023-04-09 15:54:07,920 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/f1266c71df54430bb3eaa7f11f4bcd05_SeqId_47_ into b269a97a2863221f6ae6fdd6f4d5f399/family1 2023-04-09 15:54:07,920 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fii5dohpmfrsv2pavabosqgfumuqdard9tdq7dtsbetnr1htg5hnchvlqo6g5vfv/family1/a73a2cabe40e4798aff7f7a742ded125 into b269a97a2863221f6ae6fdd6f4d5f399/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/f1266c71df54430bb3eaa7f11f4bcd05_SeqId_47_) 2023-04-09 15:54:07,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fii5dohpmfrsv2pavabosqgfumuqdard9tdq7dtsbetnr1htg5hnchvlqo6g5vfv/family1/a73a2cabe40e4798aff7f7a742ded125 2023-04-09 15:54:07,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-04-09 15:54:07,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-04-09 15:54:07,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(1912): b269a97a2863221f6ae6fdd6f4d5f399/family1 is initiating minor compaction (all files) 2023-04-09 15:54:07,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5a720fde; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:07,922 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b269a97a2863221f6ae6fdd6f4d5f399/family1 in testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:54:07,922 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/85624bf8ed4145adb1c99f00b25274ad, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/f0a058255b1c46ba9e35d339aeeaa4d4, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/f1266c71df54430bb3eaa7f11f4bcd05_SeqId_47_] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp, totalSize=176.8 K 2023-04-09 15:54:07,922 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 85624bf8ed4145adb1c99f00b25274ad, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842473 2023-04-09 15:54:07,923 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting f0a058255b1c46ba9e35d339aeeaa4d4, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242473 2023-04-09 15:54:07,923 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting f1266c71df54430bb3eaa7f11f4bcd05_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965242473 2023-04-09 15:54:07,924 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-04-09 15:54:07,924 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:07,926 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120167c3839e280748f1b56792cf4459df6c to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120167c3839e280748f1b56792cf4459df6c 2023-04-09 15:54:07,927 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512059a2e655136cf4534a6d47c1bcd26cbf6 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512059a2e655136cf4534a6d47c1bcd26cbf6 2023-04-09 15:54:07,927 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-04-09 15:54:07,927 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-04-09 15:54:07,928 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:07,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-04-09 15:54:07,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:07,929 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-04-09 15:54:07,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8070 sec 2023-04-09 15:54:07,939 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] throttle.PressureAwareThroughputController(145): b269a97a2863221f6ae6fdd6f4d5f399#family1#compaction#34 average throughput is 22.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:54:07,955 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/3dcc646beda2458daea289eae3895229, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/e3d5f44ad6a4456d87536509b208dcd2, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/33f48d41f2754ac2829da7263f46880f, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/a8a4e58af63441498a1687799e2ee558, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/ec48a0a0b5f646319898fe084d5ae12d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/e81c94b7a8f1447ab2256e65de664160, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/2434c22cfc0345ab8d10ddbe3e2bc475, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/0a5c1a67da4d408e992e1af95614aafc, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/809381a526c647bc8f2100bde3e28535, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/fa1ba25fb83a48e88c79c2b6b94ff629_SeqId_44_] to archive 2023-04-09 15:54:07,955 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:07,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/3dcc646beda2458daea289eae3895229 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/3dcc646beda2458daea289eae3895229 2023-04-09 15:54:07,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/e3d5f44ad6a4456d87536509b208dcd2 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/e3d5f44ad6a4456d87536509b208dcd2 2023-04-09 15:54:07,960 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/33f48d41f2754ac2829da7263f46880f to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/33f48d41f2754ac2829da7263f46880f 2023-04-09 15:54:07,962 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/a8a4e58af63441498a1687799e2ee558 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/a8a4e58af63441498a1687799e2ee558 2023-04-09 15:54:07,963 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/ec48a0a0b5f646319898fe084d5ae12d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/ec48a0a0b5f646319898fe084d5ae12d 2023-04-09 15:54:07,965 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/e81c94b7a8f1447ab2256e65de664160 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/e81c94b7a8f1447ab2256e65de664160 2023-04-09 15:54:07,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/2434c22cfc0345ab8d10ddbe3e2bc475 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/2434c22cfc0345ab8d10ddbe3e2bc475 2023-04-09 15:54:07,970 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/0a5c1a67da4d408e992e1af95614aafc to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/0a5c1a67da4d408e992e1af95614aafc 2023-04-09 15:54:07,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/809381a526c647bc8f2100bde3e28535 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/809381a526c647bc8f2100bde3e28535 2023-04-09 15:54:07,972 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/fa1ba25fb83a48e88c79c2b6b94ff629_SeqId_44_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/fa1ba25fb83a48e88c79c2b6b94ff629_SeqId_44_ 2023-04-09 15:54:07,973 DEBUG [hfile_cleaner-dir-scan-pool-1] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 29 more 2023-04-09 15:54:08,035 INFO [Listener at localhost/39283] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=257 (was 265), OpenFileDescriptor=615 (was 635), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=333 (was 358), ProcessCount=169 (was 169), AvailableMemoryMB=1792 (was 1888) 2023-04-09 15:54:08,046 INFO [Listener at localhost/39283] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=257, OpenFileDescriptor=615, MaxFileDescriptor=60000, SystemLoadAverage=333, ProcessCount=169, AvailableMemoryMB=1791 2023-04-09 15:54:08,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-04-09 15:54:08,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:08,051 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-04-09 15:54:08,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-04-09 15:54:08,052 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-09 15:54:08,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-04-09 15:54:08,055 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/77d5b71581c09b60462c27bd8b7a6175 2023-04-09 15:54:08,055 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4080ebf9e93974f9f93ba5eddeae10ae 2023-04-09 15:54:08,055 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc 2023-04-09 15:54:08,055 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/77d5b71581c09b60462c27bd8b7a6175 empty. 2023-04-09 15:54:08,055 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc empty. 2023-04-09 15:54:08,055 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4080ebf9e93974f9f93ba5eddeae10ae empty. 2023-04-09 15:54:08,056 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/77d5b71581c09b60462c27bd8b7a6175 2023-04-09 15:54:08,056 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc 2023-04-09 15:54:08,056 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4080ebf9e93974f9f93ba5eddeae10ae 2023-04-09 15:54:08,056 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-04-09 15:54:08,067 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-04-09 15:54:08,068 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 77d5b71581c09b60462c27bd8b7a6175, NAME => 'testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:54:08,068 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4080ebf9e93974f9f93ba5eddeae10ae, NAME => 'testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:54:08,072 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 2160f8ec02730d020d47e45eb2c00ccc, NAME => 'testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:54:08,077 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:08,077 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 2160f8ec02730d020d47e45eb2c00ccc, disabling compactions & flushes 2023-04-09 15:54:08,077 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. 2023-04-09 15:54:08,077 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. 2023-04-09 15:54:08,077 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. after waiting 0 ms 2023-04-09 15:54:08,077 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. 2023-04-09 15:54:08,077 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. 2023-04-09 15:54:08,077 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 2160f8ec02730d020d47e45eb2c00ccc: 2023-04-09 15:54:08,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-04-09 15:54:08,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-04-09 15:54:08,477 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:08,478 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 77d5b71581c09b60462c27bd8b7a6175, disabling compactions & flushes 2023-04-09 15:54:08,478 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. 2023-04-09 15:54:08,478 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. 2023-04-09 15:54:08,478 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. after waiting 0 ms 2023-04-09 15:54:08,478 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. 2023-04-09 15:54:08,478 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. 2023-04-09 15:54:08,478 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 77d5b71581c09b60462c27bd8b7a6175: 2023-04-09 15:54:08,478 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:08,478 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 4080ebf9e93974f9f93ba5eddeae10ae, disabling compactions & flushes 2023-04-09 15:54:08,478 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. 2023-04-09 15:54:08,478 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. 2023-04-09 15:54:08,478 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. after waiting 0 ms 2023-04-09 15:54:08,478 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. 2023-04-09 15:54:08,478 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. 2023-04-09 15:54:08,478 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 4080ebf9e93974f9f93ba5eddeae10ae: 2023-04-09 15:54:08,481 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-04-09 15:54:08,481 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1681055648481"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055648481"}]},"ts":"1681055648481"} 2023-04-09 15:54:08,482 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1681055648481"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055648481"}]},"ts":"1681055648481"} 2023-04-09 15:54:08,482 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1681055648481"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055648481"}]},"ts":"1681055648481"} 2023-04-09 15:54:08,484 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-04-09 15:54:08,485 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-09 15:54:08,486 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055648485"}]},"ts":"1681055648485"} 2023-04-09 15:54:08,487 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-04-09 15:54:08,489 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=77d5b71581c09b60462c27bd8b7a6175, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4080ebf9e93974f9f93ba5eddeae10ae, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2160f8ec02730d020d47e45eb2c00ccc, ASSIGN}] 2023-04-09 15:54:08,491 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2160f8ec02730d020d47e45eb2c00ccc, ASSIGN 2023-04-09 15:54:08,491 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=77d5b71581c09b60462c27bd8b7a6175, ASSIGN 2023-04-09 15:54:08,491 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4080ebf9e93974f9f93ba5eddeae10ae, ASSIGN 2023-04-09 15:54:08,492 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2160f8ec02730d020d47e45eb2c00ccc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:54:08,492 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4080ebf9e93974f9f93ba5eddeae10ae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:54:08,492 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=77d5b71581c09b60462c27bd8b7a6175, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:54:08,643 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=2160f8ec02730d020d47e45eb2c00ccc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:08,643 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=77d5b71581c09b60462c27bd8b7a6175, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:08,643 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4080ebf9e93974f9f93ba5eddeae10ae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:08,644 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1681055648643"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055648643"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055648643"}]},"ts":"1681055648643"} 2023-04-09 15:54:08,644 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1681055648643"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055648643"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055648643"}]},"ts":"1681055648643"} 2023-04-09 15:54:08,644 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1681055648643"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055648643"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055648643"}]},"ts":"1681055648643"} 2023-04-09 15:54:08,646 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 4080ebf9e93974f9f93ba5eddeae10ae, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:08,646 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure 2160f8ec02730d020d47e45eb2c00ccc, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:08,647 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure 77d5b71581c09b60462c27bd8b7a6175, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:08,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-04-09 15:54:08,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. 2023-04-09 15:54:08,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 77d5b71581c09b60462c27bd8b7a6175, NAME => 'testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175.', STARTKEY => '', ENDKEY => '1'} 2023-04-09 15:54:08,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 77d5b71581c09b60462c27bd8b7a6175 2023-04-09 15:54:08,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:08,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 77d5b71581c09b60462c27bd8b7a6175 2023-04-09 15:54:08,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 77d5b71581c09b60462c27bd8b7a6175 2023-04-09 15:54:08,802 INFO [StoreOpener-77d5b71581c09b60462c27bd8b7a6175-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 77d5b71581c09b60462c27bd8b7a6175 2023-04-09 15:54:08,804 DEBUG [StoreOpener-77d5b71581c09b60462c27bd8b7a6175-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/77d5b71581c09b60462c27bd8b7a6175/family1 2023-04-09 15:54:08,804 DEBUG [StoreOpener-77d5b71581c09b60462c27bd8b7a6175-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/77d5b71581c09b60462c27bd8b7a6175/family1 2023-04-09 15:54:08,804 INFO [StoreOpener-77d5b71581c09b60462c27bd8b7a6175-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77d5b71581c09b60462c27bd8b7a6175 columnFamilyName family1 2023-04-09 15:54:08,806 INFO [StoreOpener-77d5b71581c09b60462c27bd8b7a6175-1] regionserver.HStore(310): Store=77d5b71581c09b60462c27bd8b7a6175/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:08,806 INFO [StoreOpener-77d5b71581c09b60462c27bd8b7a6175-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 77d5b71581c09b60462c27bd8b7a6175 2023-04-09 15:54:08,807 DEBUG [StoreOpener-77d5b71581c09b60462c27bd8b7a6175-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/77d5b71581c09b60462c27bd8b7a6175/family2 2023-04-09 15:54:08,807 DEBUG [StoreOpener-77d5b71581c09b60462c27bd8b7a6175-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/77d5b71581c09b60462c27bd8b7a6175/family2 2023-04-09 15:54:08,807 INFO [StoreOpener-77d5b71581c09b60462c27bd8b7a6175-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77d5b71581c09b60462c27bd8b7a6175 columnFamilyName family2 2023-04-09 15:54:08,809 INFO [StoreOpener-77d5b71581c09b60462c27bd8b7a6175-1] regionserver.HStore(310): Store=77d5b71581c09b60462c27bd8b7a6175/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:08,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/77d5b71581c09b60462c27bd8b7a6175 2023-04-09 15:54:08,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/77d5b71581c09b60462c27bd8b7a6175 2023-04-09 15:54:08,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-09 15:54:08,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 77d5b71581c09b60462c27bd8b7a6175 2023-04-09 15:54:08,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/77d5b71581c09b60462c27bd8b7a6175/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:54:08,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 77d5b71581c09b60462c27bd8b7a6175; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71380700, jitterRate=0.0636553168296814}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-09 15:54:08,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 77d5b71581c09b60462c27bd8b7a6175: 2023-04-09 15:54:08,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175., pid=33, masterSystemTime=1681055648798 2023-04-09 15:54:08,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. 2023-04-09 15:54:08,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. 2023-04-09 15:54:08,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. 2023-04-09 15:54:08,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2160f8ec02730d020d47e45eb2c00ccc, NAME => 'testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc.', STARTKEY => '2', ENDKEY => ''} 2023-04-09 15:54:08,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 2160f8ec02730d020d47e45eb2c00ccc 2023-04-09 15:54:08,818 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=77d5b71581c09b60462c27bd8b7a6175, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:08,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:08,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2160f8ec02730d020d47e45eb2c00ccc 2023-04-09 15:54:08,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2160f8ec02730d020d47e45eb2c00ccc 2023-04-09 15:54:08,818 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1681055648818"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055648818"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055648818"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055648818"}]},"ts":"1681055648818"} 2023-04-09 15:54:08,819 INFO [StoreOpener-2160f8ec02730d020d47e45eb2c00ccc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2160f8ec02730d020d47e45eb2c00ccc 2023-04-09 15:54:08,821 DEBUG [StoreOpener-2160f8ec02730d020d47e45eb2c00ccc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1 2023-04-09 15:54:08,821 DEBUG [StoreOpener-2160f8ec02730d020d47e45eb2c00ccc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1 2023-04-09 15:54:08,821 INFO [StoreOpener-2160f8ec02730d020d47e45eb2c00ccc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2160f8ec02730d020d47e45eb2c00ccc columnFamilyName family1 2023-04-09 15:54:08,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=28 2023-04-09 15:54:08,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure 77d5b71581c09b60462c27bd8b7a6175, server=jenkins-hbase4.apache.org,44869,1681055618167 in 172 msec 2023-04-09 15:54:08,822 INFO [StoreOpener-2160f8ec02730d020d47e45eb2c00ccc-1] regionserver.HStore(310): Store=2160f8ec02730d020d47e45eb2c00ccc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:08,822 INFO [StoreOpener-2160f8ec02730d020d47e45eb2c00ccc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2160f8ec02730d020d47e45eb2c00ccc 2023-04-09 15:54:08,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=77d5b71581c09b60462c27bd8b7a6175, ASSIGN in 332 msec 2023-04-09 15:54:08,824 DEBUG [StoreOpener-2160f8ec02730d020d47e45eb2c00ccc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family2 2023-04-09 15:54:08,824 DEBUG [StoreOpener-2160f8ec02730d020d47e45eb2c00ccc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family2 2023-04-09 15:54:08,824 INFO [StoreOpener-2160f8ec02730d020d47e45eb2c00ccc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2160f8ec02730d020d47e45eb2c00ccc columnFamilyName family2 2023-04-09 15:54:08,825 INFO [StoreOpener-2160f8ec02730d020d47e45eb2c00ccc-1] regionserver.HStore(310): Store=2160f8ec02730d020d47e45eb2c00ccc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:08,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc 2023-04-09 15:54:08,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc 2023-04-09 15:54:08,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-09 15:54:08,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2160f8ec02730d020d47e45eb2c00ccc 2023-04-09 15:54:08,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:54:08,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2160f8ec02730d020d47e45eb2c00ccc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69197475, jitterRate=0.031122729182243347}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-09 15:54:08,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2160f8ec02730d020d47e45eb2c00ccc: 2023-04-09 15:54:08,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc., pid=32, masterSystemTime=1681055648798 2023-04-09 15:54:08,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. 2023-04-09 15:54:08,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. 2023-04-09 15:54:08,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. 2023-04-09 15:54:08,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4080ebf9e93974f9f93ba5eddeae10ae, NAME => 'testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae.', STARTKEY => '1', ENDKEY => '2'} 2023-04-09 15:54:08,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 4080ebf9e93974f9f93ba5eddeae10ae 2023-04-09 15:54:08,834 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=2160f8ec02730d020d47e45eb2c00ccc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:08,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:08,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4080ebf9e93974f9f93ba5eddeae10ae 2023-04-09 15:54:08,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4080ebf9e93974f9f93ba5eddeae10ae 2023-04-09 15:54:08,834 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1681055648834"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055648834"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055648834"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055648834"}]},"ts":"1681055648834"} 2023-04-09 15:54:08,835 INFO [StoreOpener-4080ebf9e93974f9f93ba5eddeae10ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4080ebf9e93974f9f93ba5eddeae10ae 2023-04-09 15:54:08,837 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=30 2023-04-09 15:54:08,837 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure 2160f8ec02730d020d47e45eb2c00ccc, server=jenkins-hbase4.apache.org,44869,1681055618167 in 189 msec 2023-04-09 15:54:08,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2160f8ec02730d020d47e45eb2c00ccc, ASSIGN in 348 msec 2023-04-09 15:54:08,843 DEBUG [StoreOpener-4080ebf9e93974f9f93ba5eddeae10ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/4080ebf9e93974f9f93ba5eddeae10ae/family1 2023-04-09 15:54:08,843 DEBUG [StoreOpener-4080ebf9e93974f9f93ba5eddeae10ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/4080ebf9e93974f9f93ba5eddeae10ae/family1 2023-04-09 15:54:08,843 INFO [StoreOpener-4080ebf9e93974f9f93ba5eddeae10ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4080ebf9e93974f9f93ba5eddeae10ae columnFamilyName family1 2023-04-09 15:54:08,844 INFO [StoreOpener-4080ebf9e93974f9f93ba5eddeae10ae-1] regionserver.HStore(310): Store=4080ebf9e93974f9f93ba5eddeae10ae/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:08,844 INFO [StoreOpener-4080ebf9e93974f9f93ba5eddeae10ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4080ebf9e93974f9f93ba5eddeae10ae 2023-04-09 15:54:08,846 DEBUG [StoreOpener-4080ebf9e93974f9f93ba5eddeae10ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/4080ebf9e93974f9f93ba5eddeae10ae/family2 2023-04-09 15:54:08,846 DEBUG [StoreOpener-4080ebf9e93974f9f93ba5eddeae10ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/4080ebf9e93974f9f93ba5eddeae10ae/family2 2023-04-09 15:54:08,846 INFO [StoreOpener-4080ebf9e93974f9f93ba5eddeae10ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4080ebf9e93974f9f93ba5eddeae10ae columnFamilyName family2 2023-04-09 15:54:08,847 INFO [StoreOpener-4080ebf9e93974f9f93ba5eddeae10ae-1] regionserver.HStore(310): Store=4080ebf9e93974f9f93ba5eddeae10ae/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:08,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/4080ebf9e93974f9f93ba5eddeae10ae 2023-04-09 15:54:08,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/4080ebf9e93974f9f93ba5eddeae10ae 2023-04-09 15:54:08,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-09 15:54:08,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4080ebf9e93974f9f93ba5eddeae10ae 2023-04-09 15:54:08,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/4080ebf9e93974f9f93ba5eddeae10ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:54:08,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4080ebf9e93974f9f93ba5eddeae10ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69210728, jitterRate=0.03132021427154541}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-09 15:54:08,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4080ebf9e93974f9f93ba5eddeae10ae: 2023-04-09 15:54:08,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae., pid=31, masterSystemTime=1681055648798 2023-04-09 15:54:08,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. 2023-04-09 15:54:08,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. 2023-04-09 15:54:08,855 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4080ebf9e93974f9f93ba5eddeae10ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:08,855 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1681055648855"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055648855"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055648855"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055648855"}]},"ts":"1681055648855"} 2023-04-09 15:54:08,859 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-04-09 15:54:08,859 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 4080ebf9e93974f9f93ba5eddeae10ae, server=jenkins-hbase4.apache.org,44869,1681055618167 in 211 msec 2023-04-09 15:54:08,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-04-09 15:54:08,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4080ebf9e93974f9f93ba5eddeae10ae, ASSIGN in 370 msec 2023-04-09 15:54:08,861 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-09 15:54:08,861 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055648861"}]},"ts":"1681055648861"} 2023-04-09 15:54:08,862 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-04-09 15:54:08,864 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-04-09 15:54:08,866 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 815 msec 2023-04-09 15:54:09,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-04-09 15:54:09,157 INFO [Listener at localhost/39283] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-04-09 15:54:09,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:09,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:09,166 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-04-09 15:54:09,166 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:09,166 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-04-09 15:54:09,166 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-04-09 15:54:09,166 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:09,166 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:09,168 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:09,168 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:09,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:09,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:09,169 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:09,169 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:09,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:09,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:09,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:09,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:09,169 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:09,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:09,170 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/.tmp/family1/0d53eadc4a094608a80a8bc8f8cfcaf9 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/0d53eadc4a094608a80a8bc8f8cfcaf9 2023-04-09 15:54:09,170 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-04-09 15:54:09,170 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:09,170 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-04-09 15:54:09,170 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. 2023-04-09 15:54:09,170 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. started... 2023-04-09 15:54:09,170 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. 2023-04-09 15:54:09,170 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. started... 2023-04-09 15:54:09,171 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-09 15:54:09,171 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:09,171 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. 2023-04-09 15:54:09,171 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. started... 2023-04-09 15:54:09,171 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4080ebf9e93974f9f93ba5eddeae10ae: 2023-04-09 15:54:09,171 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2160f8ec02730d020d47e45eb2c00ccc 2/2 column families, dataSize=48 B heapSize=632 B 2023-04-09 15:54:09,172 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 77d5b71581c09b60462c27bd8b7a6175: 2023-04-09 15:54:09,172 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. 2023-04-09 15:54:09,172 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. 2023-04-09 15:54:09,172 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-09 15:54:09,172 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-09 15:54:09,176 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b269a97a2863221f6ae6fdd6f4d5f399/family1 of b269a97a2863221f6ae6fdd6f4d5f399 into 0d53eadc4a094608a80a8bc8f8cfcaf9(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-09 15:54:09,176 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b269a97a2863221f6ae6fdd6f4d5f399: 2023-04-09 15:54:09,176 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1681055647922; duration=1sec 2023-04-09 15:54:09,177 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:09,242 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/85624bf8ed4145adb1c99f00b25274ad, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/f0a058255b1c46ba9e35d339aeeaa4d4, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/f1266c71df54430bb3eaa7f11f4bcd05_SeqId_47_] to archive 2023-04-09 15:54:09,242 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:09,244 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/85624bf8ed4145adb1c99f00b25274ad to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/85624bf8ed4145adb1c99f00b25274ad 2023-04-09 15:54:09,246 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/f0a058255b1c46ba9e35d339aeeaa4d4 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/f0a058255b1c46ba9e35d339aeeaa4d4 2023-04-09 15:54:09,247 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/f1266c71df54430bb3eaa7f11f4bcd05_SeqId_47_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/family1/f1266c71df54430bb3eaa7f11f4bcd05_SeqId_47_ 2023-04-09 15:54:09,584 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304099f798dc6e8584058b3b809924446a1b9 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202304099f798dc6e8584058b3b809924446a1b9 2023-04-09 15:54:09,990 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/.tmp/family1/0065110e52104c4ba2002775a932cba3 2023-04-09 15:54:09,995 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/.tmp/family1/0065110e52104c4ba2002775a932cba3 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/0065110e52104c4ba2002775a932cba3 2023-04-09 15:54:09,999 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/0065110e52104c4ba2002775a932cba3, entries=1, sequenceid=5, filesize=4.9 K 2023-04-09 15:54:10,000 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 2160f8ec02730d020d47e45eb2c00ccc in 829ms, sequenceid=5, compaction requested=false 2023-04-09 15:54:10,000 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-04-09 15:54:10,000 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2160f8ec02730d020d47e45eb2c00ccc: 2023-04-09 15:54:10,000 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. 2023-04-09 15:54:10,000 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-09 15:54:10,000 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-09 15:54:10,000 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,001 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-04-09 15:54:10,001 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-04-09 15:54:10,002 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,002 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:10,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:10,002 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,003 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:10,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:10,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:10,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:10,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-04-09 15:54:10,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@665e2142[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:10,004 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-04-09 15:54:10,004 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,005 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,005 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-04-09 15:54:10,005 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-04-09 15:54:10,005 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:10,005 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,005 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:10,006 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,006 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-04-09 15:54:10,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,007 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:10,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:10,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:10,007 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-04-09 15:54:10,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:10,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:10,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:10,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:10,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-04-09 15:54:10,009 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-04-09 15:54:10,009 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:10,009 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:10,009 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,009 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:10,011 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,011 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:10,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:10,012 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:10,012 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:10,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:10,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:10,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:10,013 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:10,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,018 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,018 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:10,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-04-09 15:54:10,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:10,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:10,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:10,018 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:10,018 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:10,018 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-04-09 15:54:10,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:10,018 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:10,019 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:10,018 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:10,019 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,019 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,019 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,019 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,119 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:10,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:10,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:10,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:10,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,126 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-04-09 15:54:10,126 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:10,126 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-04-09 15:54:10,126 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-04-09 15:54:10,126 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,126 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,128 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,128 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:10,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:10,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:10,128 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,128 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:10,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:10,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,129 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,129 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-04-09 15:54:10,129 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,129 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-04-09 15:54:10,129 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:10,129 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-04-09 15:54:10,129 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. 2023-04-09 15:54:10,129 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. started... 2023-04-09 15:54:10,129 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-09 15:54:10,129 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:10,129 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. 2023-04-09 15:54:10,130 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4080ebf9e93974f9f93ba5eddeae10ae: 2023-04-09 15:54:10,130 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. 2023-04-09 15:54:10,130 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. 2023-04-09 15:54:10,130 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-09 15:54:10,130 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. started... 2023-04-09 15:54:10,130 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. started... 2023-04-09 15:54:10,130 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 77d5b71581c09b60462c27bd8b7a6175: 2023-04-09 15:54:10,130 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2160f8ec02730d020d47e45eb2c00ccc 2/2 column families, dataSize=90 B heapSize=752 B 2023-04-09 15:54:10,130 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. 2023-04-09 15:54:10,130 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-09 15:54:10,543 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409fdefa277a1b146fa99f867eb17273200 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230409fdefa277a1b146fa99f867eb17273200 2023-04-09 15:54:10,949 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/.tmp/family1/b71802536ab249ed8b035783b0ec6a26 2023-04-09 15:54:10,954 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/.tmp/family1/b71802536ab249ed8b035783b0ec6a26 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/b71802536ab249ed8b035783b0ec6a26 2023-04-09 15:54:10,958 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/b71802536ab249ed8b035783b0ec6a26, entries=2, sequenceid=9, filesize=5.0 K 2023-04-09 15:54:10,959 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 2160f8ec02730d020d47e45eb2c00ccc in 829ms, sequenceid=9, compaction requested=false 2023-04-09 15:54:10,960 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2160f8ec02730d020d47e45eb2c00ccc: 2023-04-09 15:54:10,960 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. 2023-04-09 15:54:10,960 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-09 15:54:10,960 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-09 15:54:10,960 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,960 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-04-09 15:54:10,960 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-04-09 15:54:10,963 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,963 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:10,963 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,963 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:10,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:10,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:10,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-04-09 15:54:10,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f70fc3d[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:10,965 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-04-09 15:54:10,965 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,966 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,966 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-04-09 15:54:10,966 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-04-09 15:54:10,966 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:10,966 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,966 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:10,967 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,967 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-04-09 15:54:10,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:10,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:10,967 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:10,967 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-04-09 15:54:10,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:10,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:10,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:10,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:10,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-04-09 15:54:10,970 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-04-09 15:54:10,970 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:10,970 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:10,970 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,970 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:10,971 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,971 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,971 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:10,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:10,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:10,972 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:10,973 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:10,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,975 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,975 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:10,975 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,975 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:10,975 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:10,976 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:10,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-04-09 15:54:10,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:10,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:10,976 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:10,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-04-09 15:54:10,976 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,976 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,976 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:10,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:10,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:10,976 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:10,976 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:11,076 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:11,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:11,085 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33617] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-04-09 15:54:11,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-04-09 15:54:11,087 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-04-09 15:54:11,088 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1681056251088 2023-04-09 15:54:11,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:11,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-09 15:54:11,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-04-09 15:54:11,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-04-09 15:54:11,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] zookeeper.ReadOnlyZKClient(139): Connect 0x7df6e648 to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:54:11,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c5130b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:54:11,094 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230409 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-04-09 15:54:11,921 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409de83b3c3527d4dd0a388027f32872b91 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230409de83b3c3527d4dd0a388027f32872b91 2023-04-09 15:54:11,922 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230409 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-04-09 15:54:11,935 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:54:11,937 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53870, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:54:11,943 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-09 15:54:11,945 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-09 15:54:11,955 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230409/family1/6d712c1231b748daabf12cc16f1bd846 first=Optional[k0] last=Optional[k1] 2023-04-09 15:54:11,955 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230409/family1/6d712c1231b748daabf12cc16f1bd846}] 2023-04-09 15:54:11,960 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230409/family1/6d712c1231b748daabf12cc16f1bd846 for inclusion in 2160f8ec02730d020d47e45eb2c00ccc/family1 2023-04-09 15:54:11,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-04-09 15:54:11,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first=2 last= 2023-04-09 15:54:11,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for 2160f8ec02730d020d47e45eb2c00ccc: 2023-04-09 15:54:11,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230409/family1/6d712c1231b748daabf12cc16f1bd846 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testScannerOnBulkLoadRefHFiles__qahii2p0dj0aci7l1v9m35h78oh3riecnph4kub7lb05i2i1trg4unopcu19smda/family1/6d712c1231b748daabf12cc16f1bd846 2023-04-09 15:54:11,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testScannerOnBulkLoadRefHFiles__qahii2p0dj0aci7l1v9m35h78oh3riecnph4kub7lb05i2i1trg4unopcu19smda/family1/6d712c1231b748daabf12cc16f1bd846 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/096bc342b3de43dfb94fe296fcc63f10_SeqId_12_ 2023-04-09 15:54:11,967 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testScannerOnBulkLoadRefHFiles__qahii2p0dj0aci7l1v9m35h78oh3riecnph4kub7lb05i2i1trg4unopcu19smda/family1/6d712c1231b748daabf12cc16f1bd846 into 2160f8ec02730d020d47e45eb2c00ccc/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/096bc342b3de43dfb94fe296fcc63f10_SeqId_12_ - updating store file list. 2023-04-09 15:54:11,971 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/096bc342b3de43dfb94fe296fcc63f10_SeqId_12_ into 2160f8ec02730d020d47e45eb2c00ccc/family1 2023-04-09 15:54:11,971 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testScannerOnBulkLoadRefHFiles__qahii2p0dj0aci7l1v9m35h78oh3riecnph4kub7lb05i2i1trg4unopcu19smda/family1/6d712c1231b748daabf12cc16f1bd846 into 2160f8ec02730d020d47e45eb2c00ccc/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/096bc342b3de43dfb94fe296fcc63f10_SeqId_12_) 2023-04-09 15:54:11,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testScannerOnBulkLoadRefHFiles__qahii2p0dj0aci7l1v9m35h78oh3riecnph4kub7lb05i2i1trg4unopcu19smda/family1/6d712c1231b748daabf12cc16f1bd846 2023-04-09 15:54:11,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-04-09 15:54:11,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-04-09 15:54:11,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(1912): 2160f8ec02730d020d47e45eb2c00ccc/family1 is initiating minor compaction (all files) 2023-04-09 15:54:11,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5887ca4b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:11,973 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2160f8ec02730d020d47e45eb2c00ccc/family1 in testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. 2023-04-09 15:54:11,973 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/0065110e52104c4ba2002775a932cba3, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/b71802536ab249ed8b035783b0ec6a26, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/096bc342b3de43dfb94fe296fcc63f10_SeqId_12_] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/.tmp, totalSize=15.1 K 2023-04-09 15:54:11,973 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 0065110e52104c4ba2002775a932cba3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055649157 2023-04-09 15:54:11,974 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting b71802536ab249ed8b035783b0ec6a26, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055649157 2023-04-09 15:54:11,974 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 096bc342b3de43dfb94fe296fcc63f10_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055649157 2023-04-09 15:54:11,975 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230409 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-04-09 15:54:11,976 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:11,978 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202304099f798dc6e8584058b3b809924446a1b9 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202304099f798dc6e8584058b3b809924446a1b9 2023-04-09 15:54:11,979 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230409fdefa277a1b146fa99f867eb17273200 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230409fdefa277a1b146fa99f867eb17273200 2023-04-09 15:54:11,979 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-04-09 15:54:11,979 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230409' 2023-04-09 15:54:11,980 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230409 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-04-09 15:54:11,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-04-09 15:54:11,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:11,981 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-04-09 15:54:11,983 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 895 msec 2023-04-09 15:54:11,986 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2160f8ec02730d020d47e45eb2c00ccc#family1#compaction#37 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:54:12,021 INFO [Listener at localhost/39283] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=258 (was 257) - Thread LEAK? -, OpenFileDescriptor=616 (was 615) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=333 (was 333), ProcessCount=169 (was 169), AvailableMemoryMB=1791 (was 1791) 2023-04-09 15:54:12,033 INFO [Listener at localhost/39283] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=256, OpenFileDescriptor=614, MaxFileDescriptor=60000, SystemLoadAverage=333, ProcessCount=169, AvailableMemoryMB=1791 2023-04-09 15:54:12,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-04-09 15:54:12,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:12,038 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-04-09 15:54:12,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-04-09 15:54:12,038 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-09 15:54:12,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-04-09 15:54:12,040 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8 2023-04-09 15:54:12,040 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8 empty. 2023-04-09 15:54:12,041 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8 2023-04-09 15:54:12,041 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-04-09 15:54:12,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-04-09 15:54:12,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-04-09 15:54:12,452 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-04-09 15:54:12,454 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => ff666b05ea15e96d41ce009aded55ec8, NAME => 'testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:54:12,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-04-09 15:54:12,864 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:12,864 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing ff666b05ea15e96d41ce009aded55ec8, disabling compactions & flushes 2023-04-09 15:54:12,864 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:12,864 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:12,864 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. after waiting 0 ms 2023-04-09 15:54:12,864 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:12,864 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:12,864 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for ff666b05ea15e96d41ce009aded55ec8: 2023-04-09 15:54:12,867 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-04-09 15:54:12,867 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1681055652867"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055652867"}]},"ts":"1681055652867"} 2023-04-09 15:54:12,869 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-04-09 15:54:12,870 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-09 15:54:12,870 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055652870"}]},"ts":"1681055652870"} 2023-04-09 15:54:12,871 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-04-09 15:54:12,874 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=ff666b05ea15e96d41ce009aded55ec8, ASSIGN}] 2023-04-09 15:54:12,875 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=ff666b05ea15e96d41ce009aded55ec8, ASSIGN 2023-04-09 15:54:12,876 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=ff666b05ea15e96d41ce009aded55ec8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:54:13,027 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=ff666b05ea15e96d41ce009aded55ec8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:13,027 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1681055653027"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055653027"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055653027"}]},"ts":"1681055653027"} 2023-04-09 15:54:13,029 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure ff666b05ea15e96d41ce009aded55ec8, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:13,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-04-09 15:54:13,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:13,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ff666b05ea15e96d41ce009aded55ec8, NAME => 'testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8.', STARTKEY => '', ENDKEY => ''} 2023-04-09 15:54:13,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy ff666b05ea15e96d41ce009aded55ec8 2023-04-09 15:54:13,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:13,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ff666b05ea15e96d41ce009aded55ec8 2023-04-09 15:54:13,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ff666b05ea15e96d41ce009aded55ec8 2023-04-09 15:54:13,185 INFO [StoreOpener-ff666b05ea15e96d41ce009aded55ec8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ff666b05ea15e96d41ce009aded55ec8 2023-04-09 15:54:13,187 DEBUG [StoreOpener-ff666b05ea15e96d41ce009aded55ec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1 2023-04-09 15:54:13,187 DEBUG [StoreOpener-ff666b05ea15e96d41ce009aded55ec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1 2023-04-09 15:54:13,187 INFO [StoreOpener-ff666b05ea15e96d41ce009aded55ec8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff666b05ea15e96d41ce009aded55ec8 columnFamilyName family1 2023-04-09 15:54:13,188 INFO [StoreOpener-ff666b05ea15e96d41ce009aded55ec8-1] regionserver.HStore(310): Store=ff666b05ea15e96d41ce009aded55ec8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:13,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8 2023-04-09 15:54:13,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8 2023-04-09 15:54:13,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ff666b05ea15e96d41ce009aded55ec8 2023-04-09 15:54:13,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:54:13,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ff666b05ea15e96d41ce009aded55ec8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71332435, jitterRate=0.06293611228466034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-09 15:54:13,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ff666b05ea15e96d41ce009aded55ec8: 2023-04-09 15:54:13,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8., pid=37, masterSystemTime=1681055653181 2023-04-09 15:54:13,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:13,196 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:13,197 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=ff666b05ea15e96d41ce009aded55ec8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:13,197 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1681055653197"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055653197"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055653197"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055653197"}]},"ts":"1681055653197"} 2023-04-09 15:54:13,200 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-04-09 15:54:13,200 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure ff666b05ea15e96d41ce009aded55ec8, server=jenkins-hbase4.apache.org,44869,1681055618167 in 169 msec 2023-04-09 15:54:13,202 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-04-09 15:54:13,202 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=ff666b05ea15e96d41ce009aded55ec8, ASSIGN in 326 msec 2023-04-09 15:54:13,202 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-09 15:54:13,202 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055653202"}]},"ts":"1681055653202"} 2023-04-09 15:54:13,204 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-04-09 15:54:13,206 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-04-09 15:54:13,206 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/.tmp/family1/a4da3d7b01844e2d8e2f33e69ecb0da8 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/a4da3d7b01844e2d8e2f33e69ecb0da8 2023-04-09 15:54:13,207 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1710 sec 2023-04-09 15:54:13,211 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 2160f8ec02730d020d47e45eb2c00ccc/family1 of 2160f8ec02730d020d47e45eb2c00ccc into a4da3d7b01844e2d8e2f33e69ecb0da8(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-09 15:54:13,211 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2160f8ec02730d020d47e45eb2c00ccc: 2023-04-09 15:54:13,211 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1681055651973; duration=1sec 2023-04-09 15:54:13,211 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:13,238 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/0065110e52104c4ba2002775a932cba3, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/b71802536ab249ed8b035783b0ec6a26, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/096bc342b3de43dfb94fe296fcc63f10_SeqId_12_] to archive 2023-04-09 15:54:13,239 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:13,241 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/0065110e52104c4ba2002775a932cba3 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/0065110e52104c4ba2002775a932cba3 2023-04-09 15:54:13,242 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/b71802536ab249ed8b035783b0ec6a26 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/b71802536ab249ed8b035783b0ec6a26 2023-04-09 15:54:13,243 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/096bc342b3de43dfb94fe296fcc63f10_SeqId_12_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/family1/096bc342b3de43dfb94fe296fcc63f10_SeqId_12_ 2023-04-09 15:54:14,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-04-09 15:54:14,144 INFO [Listener at localhost/39283] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-04-09 15:54:14,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:14,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:14,167 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:14,167 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:14,167 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:14,167 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:14,168 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:14,168 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:14,169 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:14,169 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:14,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:14,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:14,169 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:14,169 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:14,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:14,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:14,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:14,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:14,170 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:14,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:14,171 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:14,171 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:14,171 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:14,171 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:14,171 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:14,171 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:14,171 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. started... 2023-04-09 15:54:14,172 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff666b05ea15e96d41ce009aded55ec8 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-04-09 15:54:14,303 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-09 15:54:14,596 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113002cacf7f6f7542ab809b83f6ab8051b9 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113002cacf7f6f7542ab809b83f6ab8051b9 2023-04-09 15:54:15,000 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/964d5eca96ab4780b01c28839b1f8f3d 2023-04-09 15:54:15,005 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/964d5eca96ab4780b01c28839b1f8f3d as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/964d5eca96ab4780b01c28839b1f8f3d 2023-04-09 15:54:15,010 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/964d5eca96ab4780b01c28839b1f8f3d, entries=1000, sequenceid=5, filesize=165.1 K 2023-04-09 15:54:15,011 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ff666b05ea15e96d41ce009aded55ec8 in 839ms, sequenceid=5, compaction requested=false 2023-04-09 15:54:15,011 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:15,011 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff666b05ea15e96d41ce009aded55ec8: 2023-04-09 15:54:15,011 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:15,011 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:15,011 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:15,011 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,011 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:15,011 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:15,013 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,013 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:15,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:15,013 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,013 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:15,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:15,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:15,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:15,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:15,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59d46f88[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:15,015 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:15,015 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,017 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,017 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:15,017 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,017 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:15,017 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:15,017 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:15,018 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:15,018 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,018 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:15,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:15,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:15,018 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:15,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:15,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:15,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:15,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:15,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:15,020 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:15,020 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:15,020 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:15,020 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,021 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:15,022 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,022 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,022 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:15,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:15,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:15,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:15,022 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:15,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:15,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:15,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,023 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:15,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,025 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,025 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,025 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,025 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:15,025 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:15,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:15,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-09 15:54:15,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:15,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:15,025 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,025 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:15,025 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:15,026 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:15,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:15,026 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:15,026 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:15,026 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,126 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:15,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:15,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:15,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:15,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,133 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:15,133 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:15,133 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:15,133 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:15,133 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,133 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,141 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:15,141 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:15,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:15,141 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,141 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:15,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:15,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,142 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,142 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-04-09 15:54:15,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,142 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:15,142 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:15,142 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:15,142 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:15,142 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:15,142 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:15,142 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. started... 2023-04-09 15:54:15,142 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff666b05ea15e96d41ce009aded55ec8 1/1 column families, dataSize=74 B heapSize=408 B 2023-04-09 15:54:15,556 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283a519469f2e14a949a2df9943b6fa5f1 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511283a519469f2e14a949a2df9943b6fa5f1 2023-04-09 15:54:15,962 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/cf77fd733588448691b657c047377912 2023-04-09 15:54:15,967 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/cf77fd733588448691b657c047377912 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/cf77fd733588448691b657c047377912 2023-04-09 15:54:15,971 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/cf77fd733588448691b657c047377912, entries=1, sequenceid=9, filesize=5.0 K 2023-04-09 15:54:15,972 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ff666b05ea15e96d41ce009aded55ec8 in 830ms, sequenceid=9, compaction requested=false 2023-04-09 15:54:15,972 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff666b05ea15e96d41ce009aded55ec8: 2023-04-09 15:54:15,972 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:15,972 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:15,972 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:15,972 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,972 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:15,972 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:15,973 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,973 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:15,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:15,974 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,974 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:15,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:15,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:15,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:15,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:15,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77d1ff44[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:15,975 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:15,975 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,980 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,980 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:15,980 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:15,980 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:15,980 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,980 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:15,987 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,988 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:15,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:15,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:15,988 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:15,988 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:15,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:15,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:15,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:15,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:15,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:15,990 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:15,990 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:15,990 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:15,990 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,990 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:15,991 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,991 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:15,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,991 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:15,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:15,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:15,992 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:15,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:15,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:15,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,993 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:15,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,995 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,995 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:15,995 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:15,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:15,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:15,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:15,995 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:15,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-09 15:54:15,995 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,995 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:15,995 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:15,995 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:15,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:15,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:15,995 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:15,995 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,995 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:15,995 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,095 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:16,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:16,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:16,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:16,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,103 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:16,103 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:16,103 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:16,103 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:16,103 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,104 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,105 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:16,105 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:16,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:16,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:16,105 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:16,105 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:16,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:16,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,106 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,106 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-04-09 15:54:16,107 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,107 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:16,107 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:16,107 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:16,107 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:16,107 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:16,107 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:16,107 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. started... 2023-04-09 15:54:16,107 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff666b05ea15e96d41ce009aded55ec8 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:16,521 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512014b99d30ef5544560ada4d6563224bc00 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512014b99d30ef5544560ada4d6563224bc00 2023-04-09 15:54:16,926 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/f3478b256149477b8fe10c46eb9808bb 2023-04-09 15:54:16,932 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/f3478b256149477b8fe10c46eb9808bb as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/f3478b256149477b8fe10c46eb9808bb 2023-04-09 15:54:16,936 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/f3478b256149477b8fe10c46eb9808bb, entries=1, sequenceid=13, filesize=4.9 K 2023-04-09 15:54:16,937 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff666b05ea15e96d41ce009aded55ec8 in 830ms, sequenceid=13, compaction requested=true 2023-04-09 15:54:16,937 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff666b05ea15e96d41ce009aded55ec8: 2023-04-09 15:54:16,937 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:16,937 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:16,937 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:16,937 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:16,937 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:16,937 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:16,940 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:16,940 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:16,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:16,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:16,940 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,941 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:16,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:16,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:16,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:16,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:16,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:16,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@601294cd[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:16,942 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:16,942 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,943 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,943 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:16,943 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:16,943 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:16,943 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:16,943 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:16,944 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:16,944 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:16,944 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:16,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:16,945 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:16,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:16,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:16,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:16,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:16,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:16,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:16,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:16,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:16,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:16,947 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:16,947 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:16,947 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:16,947 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,947 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:16,948 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,948 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,948 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:16,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:16,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:16,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:16,949 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:16,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:16,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:16,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:16,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,950 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:16,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:16,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:16,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:16,952 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:16,953 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:16,953 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,953 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:16,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:16,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:16,953 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:16,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:16,953 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:16,953 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:16,953 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,953 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:16,953 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:16,953 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:16,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:16,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:16,953 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,053 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:17,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:17,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:17,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:17,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,060 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:17,060 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:17,060 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:17,060 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:17,060 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,060 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,061 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:17,061 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:17,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:17,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:17,062 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:17,062 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:17,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:17,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,063 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,063 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-04-09 15:54:17,063 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,063 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:17,063 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:17,063 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:17,063 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:17,063 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:17,063 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:17,063 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. started... 2023-04-09 15:54:17,063 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff666b05ea15e96d41ce009aded55ec8 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:17,476 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205828ad8b4833541198a199f40cf103068 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205828ad8b4833541198a199f40cf103068 2023-04-09 15:54:17,882 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/5ca7334539994b2b9322eaffab63ac0c 2023-04-09 15:54:17,887 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/5ca7334539994b2b9322eaffab63ac0c as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/5ca7334539994b2b9322eaffab63ac0c 2023-04-09 15:54:17,891 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/5ca7334539994b2b9322eaffab63ac0c, entries=1, sequenceid=17, filesize=4.9 K 2023-04-09 15:54:17,892 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff666b05ea15e96d41ce009aded55ec8 in 829ms, sequenceid=17, compaction requested=true 2023-04-09 15:54:17,892 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff666b05ea15e96d41ce009aded55ec8: 2023-04-09 15:54:17,892 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:17,892 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:17,892 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:17,892 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:17,892 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:17,892 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:17,894 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:17,894 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:17,894 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,894 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:17,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:17,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@187b0de6[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:17,895 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:17,896 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,896 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,897 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:17,897 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:17,897 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:17,897 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:17,897 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:17,899 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:17,899 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:17,899 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:17,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:17,899 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:17,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:17,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:17,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:17,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:17,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:17,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:17,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:17,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:17,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:17,902 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:17,902 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:17,902 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:17,902 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,902 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:17,903 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,903 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:17,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:17,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,903 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:17,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:17,904 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:17,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:17,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:17,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,905 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:17,907 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:17,907 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:17,907 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:17,907 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:17,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:17,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:17,907 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,907 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:17,907 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:17,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:17,907 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,907 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,907 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:17,907 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:17,907 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:17,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:17,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:18,008 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:18,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:18,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:18,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:18,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,014 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:18,014 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:18,014 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:18,014 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:18,015 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,015 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,016 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,016 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:18,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:18,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:18,016 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,016 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:18,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:18,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,017 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,017 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-04-09 15:54:18,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,017 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:18,017 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:18,017 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:18,017 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:18,017 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:18,017 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:18,018 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. started... 2023-04-09 15:54:18,018 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff666b05ea15e96d41ce009aded55ec8 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:18,430 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285d1e595ee337495cb89f94e524ddbb24 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512285d1e595ee337495cb89f94e524ddbb24 2023-04-09 15:54:18,437 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/218dbedc718e40e3a8fb8a7e13577dab 2023-04-09 15:54:18,441 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/218dbedc718e40e3a8fb8a7e13577dab as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/218dbedc718e40e3a8fb8a7e13577dab 2023-04-09 15:54:18,446 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/218dbedc718e40e3a8fb8a7e13577dab, entries=1, sequenceid=21, filesize=4.9 K 2023-04-09 15:54:18,446 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff666b05ea15e96d41ce009aded55ec8 in 428ms, sequenceid=21, compaction requested=true 2023-04-09 15:54:18,447 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff666b05ea15e96d41ce009aded55ec8: 2023-04-09 15:54:18,447 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:18,447 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:18,447 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:18,447 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,447 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:18,447 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:18,451 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,451 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:18,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:18,452 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,452 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:18,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:18,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:18,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:18,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:18,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62a9894e[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:18,453 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:18,453 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,454 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,455 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:18,455 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:18,455 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:18,455 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,455 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:18,457 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:18,457 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,457 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:18,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:18,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:18,457 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:18,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:18,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:18,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:18,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:18,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:18,459 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:18,459 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:18,459 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:18,459 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,460 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:18,461 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,461 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,461 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:18,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:18,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:18,462 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:18,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:18,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:18,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:18,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,463 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:18,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,466 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:18,466 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:18,466 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,466 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:18,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:18,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:18,466 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:18,466 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,466 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:18,466 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:18,466 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-09 15:54:18,466 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,466 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:18,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:18,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:18,466 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,467 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,567 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:18,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:18,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:18,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:18,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,574 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:18,574 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:18,574 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:18,574 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:18,575 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,575 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,576 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:18,576 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:18,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:18,577 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:18,577 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:18,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:18,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,577 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,577 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-04-09 15:54:18,577 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:18,578 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:18,578 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:18,578 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:18,578 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:18,578 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:18,578 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:18,578 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. started... 2023-04-09 15:54:18,578 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff666b05ea15e96d41ce009aded55ec8 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:18,991 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123122e3d1ade42746ae83a97d95b52dea39 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123122e3d1ade42746ae83a97d95b52dea39 2023-04-09 15:54:19,396 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/5610899823b5490787fbf926b41ef639 2023-04-09 15:54:19,400 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/5610899823b5490787fbf926b41ef639 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/5610899823b5490787fbf926b41ef639 2023-04-09 15:54:19,404 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/5610899823b5490787fbf926b41ef639, entries=1, sequenceid=25, filesize=4.9 K 2023-04-09 15:54:19,405 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff666b05ea15e96d41ce009aded55ec8 in 827ms, sequenceid=25, compaction requested=true 2023-04-09 15:54:19,405 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff666b05ea15e96d41ce009aded55ec8: 2023-04-09 15:54:19,405 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:19,406 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:19,406 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:19,406 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,406 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:19,406 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:19,408 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,408 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:19,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:19,409 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,409 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:19,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:19,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:19,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:19,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:19,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a7a7180[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:19,410 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:19,410 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,411 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,412 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:19,412 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:19,412 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:19,412 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,412 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:19,413 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:19,413 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:19,413 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:19,416 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:19,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:19,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:19,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:19,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:19,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:19,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:19,420 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:19,420 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:19,420 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:19,420 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,420 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:19,422 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,422 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,422 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:19,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:19,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:19,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:19,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:19,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:19,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,423 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:19,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,426 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:19,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,434 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:19,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:19,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:19,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:19,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:19,434 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:19,434 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-09 15:54:19,434 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,435 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,434 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:19,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:19,435 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:19,435 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,435 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,435 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,435 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,435 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,435 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:19,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:19,535 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:19,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:19,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:19,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:19,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,548 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:19,548 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:19,548 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:19,548 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:19,550 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,550 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,551 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:19,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:19,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:19,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,552 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:19,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,553 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,553 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,553 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:19,556 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-04-09 15:54:19,556 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,556 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:19,556 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:19,556 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:19,556 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:19,556 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:19,557 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:19,557 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. started... 2023-04-09 15:54:19,557 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff666b05ea15e96d41ce009aded55ec8 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:19,602 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010104e6c006b26a433594b0c2ba78956f81 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010104e6c006b26a433594b0c2ba78956f81 2023-04-09 15:54:19,618 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/abf3a806038344a4bf53286b65f6d73b 2023-04-09 15:54:19,625 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/abf3a806038344a4bf53286b65f6d73b as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/abf3a806038344a4bf53286b65f6d73b 2023-04-09 15:54:19,633 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/abf3a806038344a4bf53286b65f6d73b, entries=1, sequenceid=29, filesize=4.9 K 2023-04-09 15:54:19,635 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff666b05ea15e96d41ce009aded55ec8 in 78ms, sequenceid=29, compaction requested=true 2023-04-09 15:54:19,635 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff666b05ea15e96d41ce009aded55ec8: 2023-04-09 15:54:19,635 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:19,635 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:19,635 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:19,635 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,636 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:19,636 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:19,638 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,638 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:19,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:19,639 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,639 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:19,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:19,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:19,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:19,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:19,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6eba2afe[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:19,640 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:19,640 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,642 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,642 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:19,642 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:19,642 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:19,643 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,643 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:19,646 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:19,646 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,646 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:19,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,646 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:19,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:19,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:19,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:19,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:19,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:19,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:19,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:19,650 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:19,650 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:19,651 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:19,651 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,651 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:19,653 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,653 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,653 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:19,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:19,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:19,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,654 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:19,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,655 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:19,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,667 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,667 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,667 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,667 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,667 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:19,667 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:19,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:19,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:19,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:19,667 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,668 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,668 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:19,667 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:19,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:19,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:19,668 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:19,668 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:19,768 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:19,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:19,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:19,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:19,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,780 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:19,780 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:19,780 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:19,780 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:19,781 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,781 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,786 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:19,787 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:19,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:19,787 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,787 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:19,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:19,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,788 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,804 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-04-09 15:54:19,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,805 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:19,805 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:19,805 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:19,805 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:19,805 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:19,805 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:19,805 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. started... 2023-04-09 15:54:19,805 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff666b05ea15e96d41ce009aded55ec8 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:19,835 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010356178c8989354e689b957d69222351ff to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010356178c8989354e689b957d69222351ff 2023-04-09 15:54:19,844 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/34c298fa0fb14e18be8101bb60908d11 2023-04-09 15:54:19,855 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/34c298fa0fb14e18be8101bb60908d11 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/34c298fa0fb14e18be8101bb60908d11 2023-04-09 15:54:19,860 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/34c298fa0fb14e18be8101bb60908d11, entries=1, sequenceid=33, filesize=4.9 K 2023-04-09 15:54:19,861 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff666b05ea15e96d41ce009aded55ec8 in 56ms, sequenceid=33, compaction requested=true 2023-04-09 15:54:19,861 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff666b05ea15e96d41ce009aded55ec8: 2023-04-09 15:54:19,861 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:19,861 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:19,861 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:19,861 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,861 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:19,861 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:19,863 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,863 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:19,863 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,863 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:19,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:19,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:19,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:19,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e6e1ef2[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:19,866 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:19,866 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,868 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,868 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:19,868 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,869 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:19,869 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:19,869 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:19,870 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:19,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:19,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:19,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:19,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:19,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:19,874 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:19,874 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:19,874 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:19,874 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,875 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:19,877 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,878 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:19,878 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:19,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:19,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:19,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:19,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:19,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,879 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:19,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,881 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:19,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,884 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,884 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,884 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,885 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,885 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,885 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:19,885 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:19,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:19,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:19,885 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,885 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:19,885 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:19,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:19,885 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:19,885 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:19,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:19,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:19,985 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:19,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:19,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:19,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:19,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,993 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:19,993 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:19,994 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:19,994 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:19,994 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,994 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:19,995 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:19,995 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:19,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:19,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:20,004 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,004 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:20,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:20,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,012 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,015 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-04-09 15:54:20,015 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,015 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:20,015 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:20,015 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:20,016 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:20,016 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:20,016 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:20,016 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. started... 2023-04-09 15:54:20,016 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff666b05ea15e96d41ce009aded55ec8 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:20,452 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ceee92dff22f4150ac36a86d8bb734e3 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907ceee92dff22f4150ac36a86d8bb734e3 2023-04-09 15:54:20,458 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/7cc4de8688d64a5981838663d882abaa 2023-04-09 15:54:20,463 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/7cc4de8688d64a5981838663d882abaa as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/7cc4de8688d64a5981838663d882abaa 2023-04-09 15:54:20,468 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/7cc4de8688d64a5981838663d882abaa, entries=1, sequenceid=37, filesize=4.9 K 2023-04-09 15:54:20,469 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff666b05ea15e96d41ce009aded55ec8 in 453ms, sequenceid=37, compaction requested=true 2023-04-09 15:54:20,470 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff666b05ea15e96d41ce009aded55ec8: 2023-04-09 15:54:20,470 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:20,470 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:20,470 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:20,470 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,470 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:20,470 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:20,472 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,472 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:20,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:20,472 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,472 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:20,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:20,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:20,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:20,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:20,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a30188[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:20,474 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:20,474 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,475 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,476 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:20,476 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:20,476 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:20,476 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,476 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:20,477 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:20,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:20,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:20,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:20,478 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:20,478 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:20,478 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:20,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:20,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:20,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:20,480 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:20,480 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:20,480 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:20,480 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,480 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:20,482 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,482 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:20,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:20,482 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:20,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,483 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:20,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:20,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:20,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:20,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,484 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:20,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,493 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,493 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,493 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,493 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:20,493 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:20,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:20,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:20,493 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,493 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,493 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,493 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,493 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:20,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:20,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:20,494 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:20,494 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:20,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-09 15:54:20,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:20,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:20,594 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:20,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:20,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:20,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:20,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,607 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:20,607 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:20,607 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-04-09 15:54:20,607 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-04-09 15:54:20,607 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,608 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,615 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:20,615 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:20,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:20,616 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,616 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:20,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:20,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,617 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,617 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-04-09 15:54:20,617 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,617 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-04-09 15:54:20,618 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:20,618 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-04-09 15:54:20,624 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:20,624 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:20,624 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:20,624 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. started... 2023-04-09 15:54:20,624 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff666b05ea15e96d41ce009aded55ec8 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:20,674 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511204a1ce9d3fb8849c88b28c6921c6804e1 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511204a1ce9d3fb8849c88b28c6921c6804e1 2023-04-09 15:54:20,693 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/b107df51b6ab4248b869cdfbd84007c1 2023-04-09 15:54:20,705 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/b107df51b6ab4248b869cdfbd84007c1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/b107df51b6ab4248b869cdfbd84007c1 2023-04-09 15:54:20,712 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/b107df51b6ab4248b869cdfbd84007c1, entries=1, sequenceid=41, filesize=4.9 K 2023-04-09 15:54:20,713 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff666b05ea15e96d41ce009aded55ec8 in 89ms, sequenceid=41, compaction requested=true 2023-04-09 15:54:20,714 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff666b05ea15e96d41ce009aded55ec8: 2023-04-09 15:54:20,714 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:20,714 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:20,714 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:20,714 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,714 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-04-09 15:54:20,714 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-04-09 15:54:20,715 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,715 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:20,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:20,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:20,716 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,716 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:20,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:20,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:20,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-04-09 15:54:20,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@491c866d[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:20,718 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-04-09 15:54:20,718 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,719 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,720 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-04-09 15:54:20,720 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-04-09 15:54:20,720 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:20,721 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-04-09 15:54:20,721 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:20,721 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-04-09 15:54:20,722 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,722 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:54:20,722 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:20,722 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-04-09 15:54:20,723 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:20,723 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:20,723 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,723 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:20,725 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,725 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:20,725 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:20,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,726 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:20,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:20,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:20,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:20,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,728 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:20,733 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,733 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,733 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,733 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:20,733 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,733 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,733 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,733 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:20,733 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:20,733 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:20,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-04-09 15:54:20,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:20,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:20,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:20,733 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:20,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-04-09 15:54:20,734 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:20,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:20,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:20,834 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:20,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:20,837 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33617] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-04-09 15:54:20,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-04-09 15:54:20,839 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-04-09 15:54:20,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:20,840 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1681056260840 2023-04-09 15:54:20,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-09 15:54:20,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-04-09 15:54:20,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-04-09 15:54:20,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] zookeeper.ReadOnlyZKClient(139): Connect 0x70c18cb8 to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:54:20,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7590eebb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:54:20,848 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:21,307 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e72124024fc0484aa3fcfba77c4eb989 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103e72124024fc0484aa3fcfba77c4eb989 2023-04-09 15:54:21,309 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-04-09 15:54:21,329 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:54:21,330 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:54:21,339 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-09 15:54:21,340 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-09 15:54:21,350 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/324602accdc74537aaf2be07e38966bb first=Optional[r3] last=Optional[r6] 2023-04-09 15:54:21,350 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/324602accdc74537aaf2be07e38966bb}] 2023-04-09 15:54:21,356 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/324602accdc74537aaf2be07e38966bb for inclusion in ff666b05ea15e96d41ce009aded55ec8/family1 2023-04-09 15:54:21,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-04-09 15:54:21,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:54:21,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for ff666b05ea15e96d41ce009aded55ec8: 2023-04-09 15:54:21,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/324602accdc74537aaf2be07e38966bb to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sndb80nen1kn5gslgns470d9l6d3belhihkrki4s4ajql2cmvf86jb0vteqiebn0/family1/324602accdc74537aaf2be07e38966bb 2023-04-09 15:54:21,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sndb80nen1kn5gslgns470d9l6d3belhihkrki4s4ajql2cmvf86jb0vteqiebn0/family1/324602accdc74537aaf2be07e38966bb as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/0bdc729e83da4b0b902fc680e2024970_SeqId_44_ 2023-04-09 15:54:21,365 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sndb80nen1kn5gslgns470d9l6d3belhihkrki4s4ajql2cmvf86jb0vteqiebn0/family1/324602accdc74537aaf2be07e38966bb into ff666b05ea15e96d41ce009aded55ec8/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/0bdc729e83da4b0b902fc680e2024970_SeqId_44_ - updating store file list. 2023-04-09 15:54:21,369 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/0bdc729e83da4b0b902fc680e2024970_SeqId_44_ into ff666b05ea15e96d41ce009aded55ec8/family1 2023-04-09 15:54:21,369 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sndb80nen1kn5gslgns470d9l6d3belhihkrki4s4ajql2cmvf86jb0vteqiebn0/family1/324602accdc74537aaf2be07e38966bb into ff666b05ea15e96d41ce009aded55ec8/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/0bdc729e83da4b0b902fc680e2024970_SeqId_44_) 2023-04-09 15:54:21,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sndb80nen1kn5gslgns470d9l6d3belhihkrki4s4ajql2cmvf86jb0vteqiebn0/family1/324602accdc74537aaf2be07e38966bb 2023-04-09 15:54:21,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-04-09 15:54:21,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-04-09 15:54:21,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(1912): ff666b05ea15e96d41ce009aded55ec8/family1 is initiating minor compaction 2023-04-09 15:54:21,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2050f8b6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:21,374 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ff666b05ea15e96d41ce009aded55ec8/family1 in testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:21,374 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/cf77fd733588448691b657c047377912, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/f3478b256149477b8fe10c46eb9808bb, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/5ca7334539994b2b9322eaffab63ac0c, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/218dbedc718e40e3a8fb8a7e13577dab, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/5610899823b5490787fbf926b41ef639, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/abf3a806038344a4bf53286b65f6d73b, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/34c298fa0fb14e18be8101bb60908d11, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/7cc4de8688d64a5981838663d882abaa, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/b107df51b6ab4248b869cdfbd84007c1, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/0bdc729e83da4b0b902fc680e2024970_SeqId_44_] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp, totalSize=50.0 K 2023-04-09 15:54:21,374 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting cf77fd733588448691b657c047377912, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-04-09 15:54:21,374 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting f3478b256149477b8fe10c46eb9808bb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-04-09 15:54:21,374 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 5ca7334539994b2b9322eaffab63ac0c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-04-09 15:54:21,375 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 218dbedc718e40e3a8fb8a7e13577dab, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-04-09 15:54:21,375 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 5610899823b5490787fbf926b41ef639, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-04-09 15:54:21,375 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting abf3a806038344a4bf53286b65f6d73b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-04-09 15:54:21,375 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 34c298fa0fb14e18be8101bb60908d11, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-04-09 15:54:21,375 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 7cc4de8688d64a5981838663d882abaa, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-04-09 15:54:21,375 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting b107df51b6ab4248b869cdfbd84007c1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-04-09 15:54:21,375 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 0bdc729e83da4b0b902fc680e2024970_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-04-09 15:54:21,376 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-04-09 15:54:21,377 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:21,378 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512285d1e595ee337495cb89f94e524ddbb24 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512285d1e595ee337495cb89f94e524ddbb24 2023-04-09 15:54:21,380 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123122e3d1ade42746ae83a97d95b52dea39 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123122e3d1ade42746ae83a97d95b52dea39 2023-04-09 15:54:21,381 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010104e6c006b26a433594b0c2ba78956f81 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010104e6c006b26a433594b0c2ba78956f81 2023-04-09 15:54:21,383 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010356178c8989354e689b957d69222351ff to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010356178c8989354e689b957d69222351ff 2023-04-09 15:54:21,383 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-04-09 15:54:21,383 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-04-09 15:54:21,383 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:21,383 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:21,383 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:21,383 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:21,384 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:21,384 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:21,384 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:21,384 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:21,421 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] throttle.PressureAwareThroughputController(145): ff666b05ea15e96d41ce009aded55ec8#family1#compaction#48 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:54:22,253 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/5faeafcd53014ee9bce976db9167ec14 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/5faeafcd53014ee9bce976db9167ec14 2023-04-09 15:54:22,259 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ff666b05ea15e96d41ce009aded55ec8/family1 of ff666b05ea15e96d41ce009aded55ec8 into 5faeafcd53014ee9bce976db9167ec14(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:54:22,259 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ff666b05ea15e96d41ce009aded55ec8: 2023-04-09 15:54:22,260 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1681055661374; duration=0sec 2023-04-09 15:54:22,260 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:22,270 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057706ab8988854823bf94c7fc38a604e7 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512057706ab8988854823bf94c7fc38a604e7 2023-04-09 15:54:22,273 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-04-09 15:54:22,320 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ed012fb2828b4a5584670c8f89cbaf74 first=Optional[r00] last=Optional[r2] 2023-04-09 15:54:22,321 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ed012fb2828b4a5584670c8f89cbaf74}] 2023-04-09 15:54:22,324 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ed012fb2828b4a5584670c8f89cbaf74 for inclusion in ff666b05ea15e96d41ce009aded55ec8/family1 2023-04-09 15:54:22,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-04-09 15:54:22,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:54:22,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for ff666b05ea15e96d41ce009aded55ec8: 2023-04-09 15:54:22,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ed012fb2828b4a5584670c8f89cbaf74 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sn4obg0ag89bn2es3f3k9hc29hh00rsi8vms79kual2ui9pr9fg60mgsutchnqno/family1/ed012fb2828b4a5584670c8f89cbaf74 2023-04-09 15:54:22,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sn4obg0ag89bn2es3f3k9hc29hh00rsi8vms79kual2ui9pr9fg60mgsutchnqno/family1/ed012fb2828b4a5584670c8f89cbaf74 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/4c9446c49c43457e9286551777725a6e_SeqId_47_ 2023-04-09 15:54:22,334 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sn4obg0ag89bn2es3f3k9hc29hh00rsi8vms79kual2ui9pr9fg60mgsutchnqno/family1/ed012fb2828b4a5584670c8f89cbaf74 into ff666b05ea15e96d41ce009aded55ec8/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/4c9446c49c43457e9286551777725a6e_SeqId_47_ - updating store file list. 2023-04-09 15:54:22,342 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/4c9446c49c43457e9286551777725a6e_SeqId_47_ into ff666b05ea15e96d41ce009aded55ec8/family1 2023-04-09 15:54:22,345 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sn4obg0ag89bn2es3f3k9hc29hh00rsi8vms79kual2ui9pr9fg60mgsutchnqno/family1/ed012fb2828b4a5584670c8f89cbaf74 into ff666b05ea15e96d41ce009aded55ec8/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/4c9446c49c43457e9286551777725a6e_SeqId_47_) 2023-04-09 15:54:22,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sn4obg0ag89bn2es3f3k9hc29hh00rsi8vms79kual2ui9pr9fg60mgsutchnqno/family1/ed012fb2828b4a5584670c8f89cbaf74 2023-04-09 15:54:22,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-04-09 15:54:22,350 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/cf77fd733588448691b657c047377912, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/f3478b256149477b8fe10c46eb9808bb, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/5ca7334539994b2b9322eaffab63ac0c, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/218dbedc718e40e3a8fb8a7e13577dab, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/5610899823b5490787fbf926b41ef639, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/abf3a806038344a4bf53286b65f6d73b, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/34c298fa0fb14e18be8101bb60908d11, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/7cc4de8688d64a5981838663d882abaa, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/b107df51b6ab4248b869cdfbd84007c1, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/0bdc729e83da4b0b902fc680e2024970_SeqId_44_] to archive 2023-04-09 15:54:22,352 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:22,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-04-09 15:54:22,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(1912): ff666b05ea15e96d41ce009aded55ec8/family1 is initiating minor compaction (all files) 2023-04-09 15:54:22,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@24ce47df; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:22,353 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ff666b05ea15e96d41ce009aded55ec8/family1 in testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:54:22,353 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/964d5eca96ab4780b01c28839b1f8f3d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/5faeafcd53014ee9bce976db9167ec14, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/4c9446c49c43457e9286551777725a6e_SeqId_47_] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp, totalSize=337.0 K 2023-04-09 15:54:22,354 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 964d5eca96ab4780b01c28839b1f8f3d, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842473 2023-04-09 15:54:22,354 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 5faeafcd53014ee9bce976db9167ec14, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242473 2023-04-09 15:54:22,355 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 4c9446c49c43457e9286551777725a6e_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878842473 2023-04-09 15:54:22,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/cf77fd733588448691b657c047377912 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/cf77fd733588448691b657c047377912 2023-04-09 15:54:22,358 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-04-09 15:54:22,359 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:22,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/f3478b256149477b8fe10c46eb9808bb to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/f3478b256149477b8fe10c46eb9808bb 2023-04-09 15:54:22,362 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113002cacf7f6f7542ab809b83f6ab8051b9 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113002cacf7f6f7542ab809b83f6ab8051b9 2023-04-09 15:54:22,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/5ca7334539994b2b9322eaffab63ac0c to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/5ca7334539994b2b9322eaffab63ac0c 2023-04-09 15:54:22,364 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512014b99d30ef5544560ada4d6563224bc00 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512014b99d30ef5544560ada4d6563224bc00 2023-04-09 15:54:22,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/218dbedc718e40e3a8fb8a7e13577dab to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/218dbedc718e40e3a8fb8a7e13577dab 2023-04-09 15:54:22,366 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205828ad8b4833541198a199f40cf103068 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205828ad8b4833541198a199f40cf103068 2023-04-09 15:54:22,366 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-04-09 15:54:22,366 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-04-09 15:54:22,367 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-04-09 15:54:22,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-04-09 15:54:22,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:22,369 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-04-09 15:54:22,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/5610899823b5490787fbf926b41ef639 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/5610899823b5490787fbf926b41ef639 2023-04-09 15:54:22,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.5320 sec 2023-04-09 15:54:22,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/abf3a806038344a4bf53286b65f6d73b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/abf3a806038344a4bf53286b65f6d73b 2023-04-09 15:54:22,379 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/34c298fa0fb14e18be8101bb60908d11 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/34c298fa0fb14e18be8101bb60908d11 2023-04-09 15:54:22,381 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/7cc4de8688d64a5981838663d882abaa to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/7cc4de8688d64a5981838663d882abaa 2023-04-09 15:54:22,384 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/b107df51b6ab4248b869cdfbd84007c1 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/b107df51b6ab4248b869cdfbd84007c1 2023-04-09 15:54:22,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/0bdc729e83da4b0b902fc680e2024970_SeqId_44_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/0bdc729e83da4b0b902fc680e2024970_SeqId_44_ 2023-04-09 15:54:22,401 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] throttle.PressureAwareThroughputController(145): ff666b05ea15e96d41ce009aded55ec8#family1#compaction#49 average throughput is 5.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:54:22,512 INFO [Listener at localhost/39283] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=266 (was 256) - Thread LEAK? -, OpenFileDescriptor=636 (was 614) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=401 (was 333) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=1751 (was 1791) 2023-04-09 15:54:22,529 INFO [Listener at localhost/39283] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=266, OpenFileDescriptor=638, MaxFileDescriptor=60000, SystemLoadAverage=401, ProcessCount=169, AvailableMemoryMB=1751 2023-04-09 15:54:22,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-04-09 15:54:22,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:22,534 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-04-09 15:54:22,535 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-09 15:54:22,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-04-09 15:54:22,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-04-09 15:54:22,537 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995 2023-04-09 15:54:22,537 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995 empty. 2023-04-09 15:54:22,538 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995 2023-04-09 15:54:22,538 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-04-09 15:54:22,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-04-09 15:54:22,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-04-09 15:54:22,960 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-04-09 15:54:22,962 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0106df3526238973fff1bd090829f995, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:54:22,969 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:22,970 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 0106df3526238973fff1bd090829f995, disabling compactions & flushes 2023-04-09 15:54:22,970 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:22,970 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:22,970 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. after waiting 0 ms 2023-04-09 15:54:22,970 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:22,970 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:22,970 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:22,972 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-04-09 15:54:22,973 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1681055662973"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055662973"}]},"ts":"1681055662973"} 2023-04-09 15:54:22,975 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-04-09 15:54:22,976 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-09 15:54:22,976 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055662976"}]},"ts":"1681055662976"} 2023-04-09 15:54:22,978 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-04-09 15:54:22,982 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0106df3526238973fff1bd090829f995, ASSIGN}] 2023-04-09 15:54:22,984 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0106df3526238973fff1bd090829f995, ASSIGN 2023-04-09 15:54:22,985 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0106df3526238973fff1bd090829f995, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:54:23,136 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=0106df3526238973fff1bd090829f995, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:23,136 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1681055663136"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055663136"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055663136"}]},"ts":"1681055663136"} 2023-04-09 15:54:23,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 0106df3526238973fff1bd090829f995, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:23,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-04-09 15:54:23,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:23,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0106df3526238973fff1bd090829f995, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.', STARTKEY => '', ENDKEY => ''} 2023-04-09 15:54:23,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 0106df3526238973fff1bd090829f995 2023-04-09 15:54:23,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:23,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0106df3526238973fff1bd090829f995 2023-04-09 15:54:23,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0106df3526238973fff1bd090829f995 2023-04-09 15:54:23,295 INFO [StoreOpener-0106df3526238973fff1bd090829f995-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0106df3526238973fff1bd090829f995 2023-04-09 15:54:23,296 DEBUG [StoreOpener-0106df3526238973fff1bd090829f995-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1 2023-04-09 15:54:23,297 DEBUG [StoreOpener-0106df3526238973fff1bd090829f995-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1 2023-04-09 15:54:23,297 INFO [StoreOpener-0106df3526238973fff1bd090829f995-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0106df3526238973fff1bd090829f995 columnFamilyName family1 2023-04-09 15:54:23,298 INFO [StoreOpener-0106df3526238973fff1bd090829f995-1] regionserver.HStore(310): Store=0106df3526238973fff1bd090829f995/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:23,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995 2023-04-09 15:54:23,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995 2023-04-09 15:54:23,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0106df3526238973fff1bd090829f995 2023-04-09 15:54:23,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:54:23,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0106df3526238973fff1bd090829f995; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72655430, jitterRate=0.08265027403831482}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-09 15:54:23,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:23,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995., pid=41, masterSystemTime=1681055663290 2023-04-09 15:54:23,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:23,308 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=0106df3526238973fff1bd090829f995, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:23,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:23,308 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1681055663308"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055663308"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055663308"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055663308"}]},"ts":"1681055663308"} 2023-04-09 15:54:23,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-04-09 15:54:23,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 0106df3526238973fff1bd090829f995, server=jenkins-hbase4.apache.org,44869,1681055618167 in 172 msec 2023-04-09 15:54:23,313 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-04-09 15:54:23,313 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0106df3526238973fff1bd090829f995, ASSIGN in 329 msec 2023-04-09 15:54:23,314 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-09 15:54:23,314 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055663314"}]},"ts":"1681055663314"} 2023-04-09 15:54:23,315 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-04-09 15:54:23,317 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-04-09 15:54:23,319 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 786 msec 2023-04-09 15:54:23,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-04-09 15:54:23,641 INFO [Listener at localhost/39283] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-04-09 15:54:23,668 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/.tmp/family1/f4829647488f491f9f9e36b3877d36c6 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/f4829647488f491f9f9e36b3877d36c6 2023-04-09 15:54:23,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:23,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:23,674 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:23,674 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:23,674 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-09 15:54:23,674 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-09 15:54:23,674 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:23,674 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:23,675 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ff666b05ea15e96d41ce009aded55ec8/family1 of ff666b05ea15e96d41ce009aded55ec8 into f4829647488f491f9f9e36b3877d36c6(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-09 15:54:23,675 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ff666b05ea15e96d41ce009aded55ec8: 2023-04-09 15:54:23,675 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1681055662353; duration=1sec 2023-04-09 15:54:23,676 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:23,676 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:23,676 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:23,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:23,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:23,677 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:23,677 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:23,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:23,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:23,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:23,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:23,677 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:23,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:23,678 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-09 15:54:23,678 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:23,678 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-09 15:54:23,678 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:23,678 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:23,678 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:23,678 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. started... 2023-04-09 15:54:23,679 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0106df3526238973fff1bd090829f995 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-04-09 15:54:23,744 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/964d5eca96ab4780b01c28839b1f8f3d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/5faeafcd53014ee9bce976db9167ec14, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/4c9446c49c43457e9286551777725a6e_SeqId_47_] to archive 2023-04-09 15:54:23,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:23,748 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/964d5eca96ab4780b01c28839b1f8f3d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/964d5eca96ab4780b01c28839b1f8f3d 2023-04-09 15:54:23,749 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/5faeafcd53014ee9bce976db9167ec14 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/5faeafcd53014ee9bce976db9167ec14 2023-04-09 15:54:23,751 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/4c9446c49c43457e9286551777725a6e_SeqId_47_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/family1/4c9446c49c43457e9286551777725a6e_SeqId_47_ 2023-04-09 15:54:24,117 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113004c4caeab5384b3989b1b5a5b01c50b2 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113004c4caeab5384b3989b1b5a5b01c50b2 2023-04-09 15:54:24,525 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/f69af19a357644da99b720426db2b7d5 2023-04-09 15:54:24,531 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/f69af19a357644da99b720426db2b7d5 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/f69af19a357644da99b720426db2b7d5 2023-04-09 15:54:24,535 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/f69af19a357644da99b720426db2b7d5, entries=1000, sequenceid=5, filesize=191.4 K 2023-04-09 15:54:24,536 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 0106df3526238973fff1bd090829f995 in 857ms, sequenceid=5, compaction requested=false 2023-04-09 15:54:24,536 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:24,537 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:24,537 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:24,537 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:24,537 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:24,537 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:24,537 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-09 15:54:24,537 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-09 15:54:24,539 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:24,539 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:24,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:24,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:24,540 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,540 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:24,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:24,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:24,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:24,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-09 15:54:24,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76ceb86a[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:24,542 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-09 15:54:24,542 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,543 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,543 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-09 15:54:24,543 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-09 15:54:24,543 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:24,543 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:24,544 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:24,546 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-09 15:54:24,546 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:24,546 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:24,546 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-09 15:54:24,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:24,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:24,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:24,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:24,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:24,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:24,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:24,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-09 15:54:24,549 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-09 15:54:24,549 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:24,549 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:24,549 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,549 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:24,556 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,556 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,556 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:24,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:24,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:24,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:24,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:24,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:24,558 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:24,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:24,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:24,559 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:24,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:24,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:24,562 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:24,562 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:24,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:24,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:24,562 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:24,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:24,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:24,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:24,562 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:24,563 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:24,563 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:24,563 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,563 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:24,563 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,563 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,563 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:24,563 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,663 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:24,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:24,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:24,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:24,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,671 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:24,671 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:24,671 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-09 15:54:24,671 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-09 15:54:24,671 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,671 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,672 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:24,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:24,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:24,673 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:24,673 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:24,673 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:24,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:24,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,674 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,674 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-04-09 15:54:24,674 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:24,674 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-09 15:54:24,674 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:24,674 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-09 15:54:24,674 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:24,674 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:24,674 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:24,675 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. started... 2023-04-09 15:54:24,675 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0106df3526238973fff1bd090829f995 1/1 column families, dataSize=74 B heapSize=408 B 2023-04-09 15:54:24,695 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a0ff61bd89eb44fa841616872c40cb16 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128a0ff61bd89eb44fa841616872c40cb16 2023-04-09 15:54:25,109 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/9c3401c8885940f7876a07c8379f6416 2023-04-09 15:54:25,115 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/9c3401c8885940f7876a07c8379f6416 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/9c3401c8885940f7876a07c8379f6416 2023-04-09 15:54:25,120 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/9c3401c8885940f7876a07c8379f6416, entries=1, sequenceid=9, filesize=5.0 K 2023-04-09 15:54:25,121 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 0106df3526238973fff1bd090829f995 in 446ms, sequenceid=9, compaction requested=false 2023-04-09 15:54:25,122 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:25,122 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:25,122 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:25,122 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:25,122 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,122 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-09 15:54:25,122 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-09 15:54:25,128 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,128 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:25,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:25,129 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,129 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:25,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:25,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:25,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:25,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-09 15:54:25,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2809a1cf[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:25,130 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-09 15:54:25,130 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,132 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,132 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-09 15:54:25,132 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-09 15:54:25,132 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:25,132 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,132 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:25,133 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,133 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-09 15:54:25,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:25,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:25,133 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:25,134 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-09 15:54:25,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:25,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:25,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:25,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-09 15:54:25,136 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-09 15:54:25,136 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:25,136 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:25,136 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,136 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:25,138 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,138 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:25,138 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:25,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:25,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:25,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,139 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,140 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,146 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,146 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,146 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,146 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,146 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,146 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,146 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:25,146 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:25,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-04-09 15:54:25,146 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:25,146 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:25,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:25,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:25,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:25,147 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:25,147 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:25,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:25,247 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:25,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:25,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:25,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:25,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,260 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:25,260 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:25,260 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-09 15:54:25,260 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-09 15:54:25,261 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,261 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,262 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,262 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:25,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:25,262 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,262 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:25,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:25,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,264 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,268 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-04-09 15:54:25,268 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,268 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-09 15:54:25,268 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:25,268 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-09 15:54:25,268 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:25,268 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:25,268 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:25,268 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. started... 2023-04-09 15:54:25,269 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0106df3526238973fff1bd090829f995 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:25,300 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201feafe2632ec04696b4f1bfe25b62c939 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201feafe2632ec04696b4f1bfe25b62c939 2023-04-09 15:54:25,715 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/b99122fef427461fa9fedb4d387e8033 2023-04-09 15:54:25,721 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/b99122fef427461fa9fedb4d387e8033 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/b99122fef427461fa9fedb4d387e8033 2023-04-09 15:54:25,726 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/b99122fef427461fa9fedb4d387e8033, entries=1, sequenceid=13, filesize=5.0 K 2023-04-09 15:54:25,726 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0106df3526238973fff1bd090829f995 in 457ms, sequenceid=13, compaction requested=true 2023-04-09 15:54:25,727 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:25,727 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:25,727 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:25,727 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:25,727 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,727 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-09 15:54:25,727 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-09 15:54:25,728 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,728 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,729 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,729 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:25,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:25,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:25,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:25,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:25,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:25,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-09 15:54:25,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30be4a07[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:25,732 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-09 15:54:25,732 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,733 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,733 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-09 15:54:25,733 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-09 15:54:25,733 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:25,736 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-09 15:54:25,736 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:25,736 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,736 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-09 15:54:25,736 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-09 15:54:25,737 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:25,737 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-09 15:54:25,737 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:25,737 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:25,737 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,737 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:25,738 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,738 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:25,738 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:25,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:25,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:25,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:25,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,741 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:25,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,742 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:25,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,744 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,744 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,744 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,744 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:25,744 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:25,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:25,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:25,744 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,744 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,744 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,744 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:25,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:25,744 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:25,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:25,745 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:25,745 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:25,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:25,845 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:25,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:25,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:25,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:25,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,853 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:25,853 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:25,853 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-09 15:54:25,853 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-09 15:54:25,854 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,854 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,855 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:25,855 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:25,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:25,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,856 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:25,856 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:25,856 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:25,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,856 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,857 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-04-09 15:54:25,857 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:25,857 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-09 15:54:25,857 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:25,857 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-09 15:54:25,857 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:25,857 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:25,857 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:25,857 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. started... 2023-04-09 15:54:25,857 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0106df3526238973fff1bd090829f995 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:25,872 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a47dbdbccec449a6ad9a24235891457f to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a47dbdbccec449a6ad9a24235891457f 2023-04-09 15:54:26,279 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/5f75a0e7f118421bb87bfa24afcc45d1 2023-04-09 15:54:26,285 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/5f75a0e7f118421bb87bfa24afcc45d1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/5f75a0e7f118421bb87bfa24afcc45d1 2023-04-09 15:54:26,303 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/5f75a0e7f118421bb87bfa24afcc45d1, entries=1, sequenceid=17, filesize=5.0 K 2023-04-09 15:54:26,305 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0106df3526238973fff1bd090829f995 in 448ms, sequenceid=17, compaction requested=true 2023-04-09 15:54:26,306 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:26,306 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:26,306 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:26,306 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:26,306 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,306 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-09 15:54:26,306 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-09 15:54:26,309 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,309 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:26,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:26,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:26,309 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,309 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:26,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:26,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:26,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-09 15:54:26,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d3c8d93[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:26,311 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-09 15:54:26,311 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,312 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,312 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-09 15:54:26,312 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-09 15:54:26,312 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:26,313 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,313 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:26,314 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,314 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-09 15:54:26,314 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:26,314 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-09 15:54:26,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:26,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:26,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:26,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:26,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:26,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:26,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-09 15:54:26,316 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-09 15:54:26,316 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:26,317 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:26,317 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,317 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:26,318 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,318 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:26,318 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:26,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:26,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:26,319 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:26,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,321 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:26,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,325 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:26,326 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:26,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:26,326 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,326 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:26,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:26,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:26,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:26,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:26,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:26,326 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:26,326 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:26,326 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,327 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,327 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,327 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,327 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,327 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,427 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:26,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:26,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:26,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:26,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,435 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:26,435 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:26,435 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-09 15:54:26,435 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-09 15:54:26,436 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,436 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,438 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:26,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:26,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:26,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,438 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:26,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,439 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,440 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-04-09 15:54:26,440 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,440 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:26,440 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,440 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-09 15:54:26,440 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:26,440 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-09 15:54:26,440 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:26,440 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:26,441 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:26,441 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. started... 2023-04-09 15:54:26,441 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0106df3526238973fff1bd090829f995 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:26,481 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512284bc983e3e4ed4acfa81fc2ae3a8bb2dd to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512284bc983e3e4ed4acfa81fc2ae3a8bb2dd 2023-04-09 15:54:26,891 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/83326a2e5d03411fb5374bcfa2995b4f 2023-04-09 15:54:26,897 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/83326a2e5d03411fb5374bcfa2995b4f as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/83326a2e5d03411fb5374bcfa2995b4f 2023-04-09 15:54:26,902 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/83326a2e5d03411fb5374bcfa2995b4f, entries=1, sequenceid=21, filesize=5.0 K 2023-04-09 15:54:26,904 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0106df3526238973fff1bd090829f995 in 463ms, sequenceid=21, compaction requested=true 2023-04-09 15:54:26,904 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:26,904 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:26,904 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:26,904 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:26,904 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,904 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-09 15:54:26,904 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-09 15:54:26,906 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,906 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:26,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:26,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:26,906 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,906 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:26,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:26,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:26,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-09 15:54:26,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e327bb6[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:26,908 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-09 15:54:26,908 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,912 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,912 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-09 15:54:26,913 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-09 15:54:26,913 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:26,913 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,913 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:26,914 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,914 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-09 15:54:26,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:26,914 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:26,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:26,914 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-09 15:54:26,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:26,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:26,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:26,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:26,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-09 15:54:26,916 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-09 15:54:26,916 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:26,916 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:26,916 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,916 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:26,918 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,918 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:26,918 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:26,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:26,918 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:26,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,920 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:26,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,924 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:26,924 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,924 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:26,924 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:26,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:26,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:26,924 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-04-09 15:54:26,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:26,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:26,924 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,924 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:26,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:26,924 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:26,925 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,925 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:26,925 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:26,925 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:26,925 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,025 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:27,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:27,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:27,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:27,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,032 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:27,032 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:27,033 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-09 15:54:27,033 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-09 15:54:27,033 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,033 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,034 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:27,034 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:27,035 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,035 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:27,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,036 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,044 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-04-09 15:54:27,045 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,045 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-09 15:54:27,045 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:27,045 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-09 15:54:27,046 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:27,047 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:27,047 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:27,047 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. started... 2023-04-09 15:54:27,047 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0106df3526238973fff1bd090829f995 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:27,063 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312ae2235049f44f16aba7847fc2a87406 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512312ae2235049f44f16aba7847fc2a87406 2023-04-09 15:54:27,069 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/290c5385c1ca40f2b53ce9a5c965ed56 2023-04-09 15:54:27,073 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/290c5385c1ca40f2b53ce9a5c965ed56 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/290c5385c1ca40f2b53ce9a5c965ed56 2023-04-09 15:54:27,079 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/290c5385c1ca40f2b53ce9a5c965ed56, entries=1, sequenceid=25, filesize=5.0 K 2023-04-09 15:54:27,080 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0106df3526238973fff1bd090829f995 in 33ms, sequenceid=25, compaction requested=true 2023-04-09 15:54:27,080 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:27,080 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:27,080 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:27,080 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:27,080 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,080 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-09 15:54:27,080 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-09 15:54:27,082 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,082 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:27,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:27,082 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,082 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:27,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:27,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:27,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:27,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-09 15:54:27,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b50b666[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:27,084 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-09 15:54:27,084 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,085 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,085 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-09 15:54:27,085 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-09 15:54:27,085 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:27,086 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,086 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:27,088 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,088 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-09 15:54:27,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:27,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:27,088 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:27,088 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-09 15:54:27,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:27,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:27,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:27,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:27,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-09 15:54:27,090 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-09 15:54:27,091 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:27,091 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:27,091 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,091 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:27,092 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,092 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:27,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:27,092 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:27,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:27,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:27,093 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:27,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:27,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,096 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:27,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,099 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,099 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:27,099 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:27,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:27,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:27,099 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,099 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,099 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,099 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,099 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,099 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:27,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-04-09 15:54:27,099 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:27,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:27,099 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:27,099 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:27,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:27,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:27,199 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:27,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:27,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:27,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:27,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,209 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:27,209 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:27,210 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-09 15:54:27,210 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-09 15:54:27,210 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,210 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,211 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:27,211 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:27,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:27,212 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,212 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:27,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,212 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:27,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,212 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,213 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-04-09 15:54:27,213 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,213 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-09 15:54:27,213 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:27,213 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-09 15:54:27,213 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:27,213 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:27,213 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:27,213 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. started... 2023-04-09 15:54:27,213 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0106df3526238973fff1bd090829f995 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:27,228 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010141e5e97d1eba43a0a4800ee73519e7ad to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010141e5e97d1eba43a0a4800ee73519e7ad 2023-04-09 15:54:27,635 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/ca59f3bdf5f5443299701f5885ad3730 2023-04-09 15:54:27,640 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/ca59f3bdf5f5443299701f5885ad3730 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/ca59f3bdf5f5443299701f5885ad3730 2023-04-09 15:54:27,645 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/ca59f3bdf5f5443299701f5885ad3730, entries=1, sequenceid=29, filesize=5.0 K 2023-04-09 15:54:27,646 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0106df3526238973fff1bd090829f995 in 433ms, sequenceid=29, compaction requested=true 2023-04-09 15:54:27,646 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:27,646 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:27,646 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:27,646 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:27,646 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,646 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-09 15:54:27,646 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-09 15:54:27,649 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,649 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:27,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:27,649 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,649 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:27,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:27,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:27,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:27,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-09 15:54:27,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@397c3579[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:27,651 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-09 15:54:27,651 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,652 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,653 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-09 15:54:27,653 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-09 15:54:27,653 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:27,653 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,653 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:27,654 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-09 15:54:27,654 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:27,654 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,654 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-09 15:54:27,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:27,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:27,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:27,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:27,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:27,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:27,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-09 15:54:27,657 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-09 15:54:27,657 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:27,657 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:27,658 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,658 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:27,659 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,659 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:27,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,659 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:27,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:27,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:27,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:27,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:27,660 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:27,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,661 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:27,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,667 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,667 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:27,667 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:27,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:27,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:27,667 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:27,667 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,667 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:27,668 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:27,668 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,668 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,668 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:27,668 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:27,668 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:27,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:27,768 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:27,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:27,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:27,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:27,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,775 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:27,775 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:27,775 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-09 15:54:27,775 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-09 15:54:27,775 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,775 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,776 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:27,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:27,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:27,776 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,777 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:27,777 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:27,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:27,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,777 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,778 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-04-09 15:54:27,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:27,778 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-09 15:54:27,778 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:27,778 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-09 15:54:27,778 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:27,778 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:27,778 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:27,778 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. started... 2023-04-09 15:54:27,778 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0106df3526238973fff1bd090829f995 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:28,192 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032d7bb25cb3f345a59786aa4b3b3d2ee8 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601032d7bb25cb3f345a59786aa4b3b3d2ee8 2023-04-09 15:54:28,347 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-09 15:54:28,347 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70c18cb8 to 127.0.0.1:64813 2023-04-09 15:54:28,347 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:54:28,347 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-09 15:54:28,347 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7df6e648 to 127.0.0.1:64813 2023-04-09 15:54:28,347 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:54:28,347 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-09 15:54:28,348 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49c0d4d3 to 127.0.0.1:64813 2023-04-09 15:54:28,348 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:54:28,598 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/25ad6d9aa6d24befab989da9cf067f19 2023-04-09 15:54:28,604 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/25ad6d9aa6d24befab989da9cf067f19 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/25ad6d9aa6d24befab989da9cf067f19 2023-04-09 15:54:28,612 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/25ad6d9aa6d24befab989da9cf067f19, entries=1, sequenceid=33, filesize=5.0 K 2023-04-09 15:54:28,613 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0106df3526238973fff1bd090829f995 in 835ms, sequenceid=33, compaction requested=true 2023-04-09 15:54:28,613 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:28,613 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:28,613 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:28,613 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:28,613 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:28,613 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-09 15:54:28,613 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-09 15:54:28,615 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,615 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:28,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:28,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:28,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:28,615 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,615 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:28,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:28,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:28,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:28,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:28,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-09 15:54:28,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@405577d0[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:28,617 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-09 15:54:28,617 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,619 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,619 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:28,620 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:28,619 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-09 15:54:28,620 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-09 15:54:28,620 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:28,623 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:28,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:28,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:28,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:28,623 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-09 15:54:28,623 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:28,623 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-09 15:54:28,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:28,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:28,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:28,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:28,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:28,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:28,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-09 15:54:28,626 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-09 15:54:28,626 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:28,626 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:28,626 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,626 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:28,628 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,628 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:28,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:28,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,628 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:28,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:28,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:28,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:28,629 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:28,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:28,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:28,631 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:28,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:28,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:28,633 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:28,633 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:28,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:28,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:28,633 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:28,633 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:28,633 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:28,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:28,633 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,633 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:28,633 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:28,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:28,633 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,634 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,634 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:28,634 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:28,734 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:28,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:28,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:28,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:28,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,741 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:28,741 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:28,741 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-09 15:54:28,741 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-09 15:54:28,742 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,742 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,743 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:28,743 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:28,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:28,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:28,743 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:28,744 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:28,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:28,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,744 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,745 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-04-09 15:54:28,745 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:28,745 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-09 15:54:28,745 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:28,745 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-09 15:54:28,745 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:28,745 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:28,745 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:28,745 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. started... 2023-04-09 15:54:28,746 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0106df3526238973fff1bd090829f995 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:28,763 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907228caa502fd44a589efe56f308a7166d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907228caa502fd44a589efe56f308a7166d 2023-04-09 15:54:28,870 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-09 15:54:29,169 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/855de20f6c5546078352e88f9a3d9ed4 2023-04-09 15:54:29,174 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/855de20f6c5546078352e88f9a3d9ed4 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/855de20f6c5546078352e88f9a3d9ed4 2023-04-09 15:54:29,179 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/855de20f6c5546078352e88f9a3d9ed4, entries=1, sequenceid=37, filesize=5.0 K 2023-04-09 15:54:29,179 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0106df3526238973fff1bd090829f995 in 433ms, sequenceid=37, compaction requested=true 2023-04-09 15:54:29,180 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:29,180 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:29,180 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:29,180 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:29,180 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,180 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-09 15:54:29,180 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-09 15:54:29,181 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,181 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:29,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:29,182 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,182 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:29,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:29,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:29,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:29,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-09 15:54:29,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4db75ba7[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:29,183 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-09 15:54:29,183 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,185 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,185 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-09 15:54:29,185 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-09 15:54:29,185 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:29,185 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,185 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:29,188 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,188 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-09 15:54:29,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:29,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:29,188 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:29,188 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-09 15:54:29,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:29,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:29,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:29,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:29,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-09 15:54:29,190 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-09 15:54:29,190 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:29,190 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:29,190 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,190 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:29,192 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,192 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:29,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,192 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:29,193 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:29,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:29,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:29,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,194 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:29,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,200 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:29,200 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,200 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:29,200 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:29,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:29,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:29,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-04-09 15:54:29,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:29,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:29,200 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,200 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,200 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,200 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,200 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,200 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:29,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:29,200 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:29,201 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:29,301 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:29,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:29,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:29,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:29,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,308 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:29,308 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:29,308 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-04-09 15:54:29,308 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-04-09 15:54:29,309 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,309 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,310 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:29,310 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:29,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:29,310 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,310 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:29,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:29,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,311 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,311 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-04-09 15:54:29,312 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,312 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-04-09 15:54:29,312 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:29,312 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-04-09 15:54:29,312 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:29,312 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:29,312 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:29,312 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. started... 2023-04-09 15:54:29,312 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0106df3526238973fff1bd090829f995 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:29,726 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112038b75ff1cc3e4b1d9f71ac277752cbde to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112038b75ff1cc3e4b1d9f71ac277752cbde 2023-04-09 15:54:29,734 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/338bcd2f2d09414e8b62d8d99cf35c32 2023-04-09 15:54:29,740 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/338bcd2f2d09414e8b62d8d99cf35c32 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/338bcd2f2d09414e8b62d8d99cf35c32 2023-04-09 15:54:29,750 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/338bcd2f2d09414e8b62d8d99cf35c32, entries=1, sequenceid=41, filesize=5.0 K 2023-04-09 15:54:29,751 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0106df3526238973fff1bd090829f995 in 439ms, sequenceid=41, compaction requested=true 2023-04-09 15:54:29,751 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:29,751 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:29,751 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:29,751 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:29,751 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,751 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-04-09 15:54:29,751 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-04-09 15:54:29,753 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,753 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:29,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:29,754 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,754 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:29,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:29,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:29,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:29,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-04-09 15:54:29,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@332a37f1[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:29,770 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-04-09 15:54:29,770 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,771 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,772 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-04-09 15:54:29,772 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-04-09 15:54:29,772 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:29,772 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,772 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:29,775 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:29,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:29,775 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-04-09 15:54:29,775 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:29,775 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-04-09 15:54:29,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:29,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:29,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:29,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:29,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-04-09 15:54:29,779 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-04-09 15:54:29,779 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:29,779 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:29,779 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,779 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:29,783 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,783 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,783 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:29,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:29,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:29,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,784 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:29,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:29,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:29,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:29,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,786 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:29,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,789 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,789 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,789 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,789 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:29,789 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:29,789 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,789 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,789 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-04-09 15:54:29,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:29,789 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:29,790 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:29,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-04-09 15:54:29,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:29,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:29,790 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:29,790 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:29,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:29,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:29,890 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:29,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:29,892 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33617] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:29,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-04-09 15:54:29,895 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-04-09 15:54:29,896 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1681056269896 2023-04-09 15:54:29,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:29,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-09 15:54:29,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-04-09 15:54:29,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-09 15:54:29,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] zookeeper.ReadOnlyZKClient(139): Connect 0x7c81bb25 to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:54:29,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e966738, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:54:29,915 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:30,416 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103232eaca4ade04af3abb401e2672e480a to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103232eaca4ade04af3abb401e2672e480a 2023-04-09 15:54:30,417 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-09 15:54:30,432 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:54:30,433 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:54:30,440 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-09 15:54:30,442 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-09 15:54:30,454 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e860b728a1434e3f80f336dfeb0a32c6 first=Optional[r3] last=Optional[r6] 2023-04-09 15:54:30,455 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e860b728a1434e3f80f336dfeb0a32c6}] 2023-04-09 15:54:30,463 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e860b728a1434e3f80f336dfeb0a32c6 for inclusion in 0106df3526238973fff1bd090829f995/family1 2023-04-09 15:54:30,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-04-09 15:54:30,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:54:30,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:30,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e860b728a1434e3f80f336dfeb0a32c6 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__k0b4jfspm0mv829o03dev5g7hb2qj31eqktle39q9l900i1visccqu38jmsb15kr/family1/e860b728a1434e3f80f336dfeb0a32c6 2023-04-09 15:54:30,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__k0b4jfspm0mv829o03dev5g7hb2qj31eqktle39q9l900i1visccqu38jmsb15kr/family1/e860b728a1434e3f80f336dfeb0a32c6 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/bfced28380a1463285137c78e8b389a5_SeqId_44_ 2023-04-09 15:54:30,471 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__k0b4jfspm0mv829o03dev5g7hb2qj31eqktle39q9l900i1visccqu38jmsb15kr/family1/e860b728a1434e3f80f336dfeb0a32c6 into 0106df3526238973fff1bd090829f995/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/bfced28380a1463285137c78e8b389a5_SeqId_44_ - updating store file list. 2023-04-09 15:54:30,475 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/bfced28380a1463285137c78e8b389a5_SeqId_44_ into 0106df3526238973fff1bd090829f995/family1 2023-04-09 15:54:30,475 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__k0b4jfspm0mv829o03dev5g7hb2qj31eqktle39q9l900i1visccqu38jmsb15kr/family1/e860b728a1434e3f80f336dfeb0a32c6 into 0106df3526238973fff1bd090829f995/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/bfced28380a1463285137c78e8b389a5_SeqId_44_) 2023-04-09 15:54:30,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__k0b4jfspm0mv829o03dev5g7hb2qj31eqktle39q9l900i1visccqu38jmsb15kr/family1/e860b728a1434e3f80f336dfeb0a32c6 2023-04-09 15:54:30,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-04-09 15:54:30,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-04-09 15:54:30,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(1912): 0106df3526238973fff1bd090829f995/family1 is initiating minor compaction 2023-04-09 15:54:30,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@361644a9; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:30,480 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0106df3526238973fff1bd090829f995/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:30,480 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/9c3401c8885940f7876a07c8379f6416, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/b99122fef427461fa9fedb4d387e8033, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/5f75a0e7f118421bb87bfa24afcc45d1, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/83326a2e5d03411fb5374bcfa2995b4f, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/290c5385c1ca40f2b53ce9a5c965ed56, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/ca59f3bdf5f5443299701f5885ad3730, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/25ad6d9aa6d24befab989da9cf067f19, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/855de20f6c5546078352e88f9a3d9ed4, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/338bcd2f2d09414e8b62d8d99cf35c32, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/bfced28380a1463285137c78e8b389a5_SeqId_44_] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp, totalSize=50.4 K 2023-04-09 15:54:30,480 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 9c3401c8885940f7876a07c8379f6416, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-04-09 15:54:30,480 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting b99122fef427461fa9fedb4d387e8033, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-04-09 15:54:30,480 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 5f75a0e7f118421bb87bfa24afcc45d1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-04-09 15:54:30,480 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 83326a2e5d03411fb5374bcfa2995b4f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-04-09 15:54:30,480 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 290c5385c1ca40f2b53ce9a5c965ed56, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-04-09 15:54:30,480 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting ca59f3bdf5f5443299701f5885ad3730, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-04-09 15:54:30,481 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 25ad6d9aa6d24befab989da9cf067f19, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-04-09 15:54:30,481 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 855de20f6c5546078352e88f9a3d9ed4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-04-09 15:54:30,481 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 338bcd2f2d09414e8b62d8d99cf35c32, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-04-09 15:54:30,481 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting bfced28380a1463285137c78e8b389a5_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-04-09 15:54:30,482 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-09 15:54:30,483 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:30,493 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512284bc983e3e4ed4acfa81fc2ae3a8bb2dd to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512284bc983e3e4ed4acfa81fc2ae3a8bb2dd 2023-04-09 15:54:30,495 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512312ae2235049f44f16aba7847fc2a87406 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512312ae2235049f44f16aba7847fc2a87406 2023-04-09 15:54:30,497 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010141e5e97d1eba43a0a4800ee73519e7ad to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010141e5e97d1eba43a0a4800ee73519e7ad 2023-04-09 15:54:30,500 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601032d7bb25cb3f345a59786aa4b3b3d2ee8 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601032d7bb25cb3f345a59786aa4b3b3d2ee8 2023-04-09 15:54:30,500 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-04-09 15:54:30,500 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-04-09 15:54:30,500 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:30,500 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:30,500 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:30,500 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:30,501 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:30,501 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:30,501 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:30,501 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:30,528 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0106df3526238973fff1bd090829f995#family1#compaction#60 average throughput is 0.32 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:54:30,567 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057dafeb2a32e54fabbc31219c407c0a11 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512057dafeb2a32e54fabbc31219c407c0a11 2023-04-09 15:54:30,568 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-09 15:54:30,601 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/27b7f9d58bee48b5824e50d38e7abbc9 first=Optional[r00] last=Optional[r2] 2023-04-09 15:54:30,604 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/27b7f9d58bee48b5824e50d38e7abbc9}] 2023-04-09 15:54:30,606 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/27b7f9d58bee48b5824e50d38e7abbc9 for inclusion in 0106df3526238973fff1bd090829f995/family1 2023-04-09 15:54:30,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-04-09 15:54:30,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:54:30,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:30,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/27b7f9d58bee48b5824e50d38e7abbc9 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__71uas61q0ckdub58u89b4vofa8rflv5mq2oakbnjr39bltuthsu62mh0e19ahq9o/family1/27b7f9d58bee48b5824e50d38e7abbc9 2023-04-09 15:54:30,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__71uas61q0ckdub58u89b4vofa8rflv5mq2oakbnjr39bltuthsu62mh0e19ahq9o/family1/27b7f9d58bee48b5824e50d38e7abbc9 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/2424c305975e46ee8a8d3f82e3c53128_SeqId_46_ 2023-04-09 15:54:30,613 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__71uas61q0ckdub58u89b4vofa8rflv5mq2oakbnjr39bltuthsu62mh0e19ahq9o/family1/27b7f9d58bee48b5824e50d38e7abbc9 into 0106df3526238973fff1bd090829f995/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/2424c305975e46ee8a8d3f82e3c53128_SeqId_46_ - updating store file list. 2023-04-09 15:54:30,618 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/2424c305975e46ee8a8d3f82e3c53128_SeqId_46_ into 0106df3526238973fff1bd090829f995/family1 2023-04-09 15:54:30,618 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__71uas61q0ckdub58u89b4vofa8rflv5mq2oakbnjr39bltuthsu62mh0e19ahq9o/family1/27b7f9d58bee48b5824e50d38e7abbc9 into 0106df3526238973fff1bd090829f995/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/2424c305975e46ee8a8d3f82e3c53128_SeqId_46_) 2023-04-09 15:54:30,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__71uas61q0ckdub58u89b4vofa8rflv5mq2oakbnjr39bltuthsu62mh0e19ahq9o/family1/27b7f9d58bee48b5824e50d38e7abbc9 2023-04-09 15:54:30,627 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-09 15:54:30,628 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:30,630 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113004c4caeab5384b3989b1b5a5b01c50b2 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113004c4caeab5384b3989b1b5a5b01c50b2 2023-04-09 15:54:30,631 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201feafe2632ec04696b4f1bfe25b62c939 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201feafe2632ec04696b4f1bfe25b62c939 2023-04-09 15:54:30,633 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a47dbdbccec449a6ad9a24235891457f to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a47dbdbccec449a6ad9a24235891457f 2023-04-09 15:54:30,633 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-04-09 15:54:30,633 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-04-09 15:54:30,633 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:30,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-09 15:54:30,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:30,635 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-04-09 15:54:30,637 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 742 msec 2023-04-09 15:54:30,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-04-09 15:54:30,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:30,801 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-04-09 15:54:30,803 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-04-09 15:54:30,803 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-04-09 15:54:30,807 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-04-09 15:54:30,818 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0106df3526238973fff1bd090829f995, REOPEN/MOVE}] 2023-04-09 15:54:30,820 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0106df3526238973fff1bd090829f995, REOPEN/MOVE 2023-04-09 15:54:30,821 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=0106df3526238973fff1bd090829f995, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:30,821 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1681055670821"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055670821"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055670821"}]},"ts":"1681055670821"} 2023-04-09 15:54:30,824 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 0106df3526238973fff1bd090829f995, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:30,951 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/68015ee8be1640f391ce79f7b8890796 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/68015ee8be1640f391ce79f7b8890796 2023-04-09 15:54:30,957 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 0106df3526238973fff1bd090829f995/family1 of 0106df3526238973fff1bd090829f995 into 68015ee8be1640f391ce79f7b8890796(size=6.8 K), total size for store is 390.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:54:30,957 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:30,957 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1681055670480; duration=0sec 2023-04-09 15:54:30,957 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:30,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0106df3526238973fff1bd090829f995 2023-04-09 15:54:30,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0106df3526238973fff1bd090829f995, disabling compactions & flushes 2023-04-09 15:54:30,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:30,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:30,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. after waiting 0 ms 2023-04-09 15:54:30,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:30,979 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/9c3401c8885940f7876a07c8379f6416, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/b99122fef427461fa9fedb4d387e8033, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/5f75a0e7f118421bb87bfa24afcc45d1, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/83326a2e5d03411fb5374bcfa2995b4f, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/290c5385c1ca40f2b53ce9a5c965ed56, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/ca59f3bdf5f5443299701f5885ad3730, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/25ad6d9aa6d24befab989da9cf067f19, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/855de20f6c5546078352e88f9a3d9ed4, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/338bcd2f2d09414e8b62d8d99cf35c32, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/bfced28380a1463285137c78e8b389a5_SeqId_44_] to archive 2023-04-09 15:54:30,991 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:30,994 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/9c3401c8885940f7876a07c8379f6416 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/9c3401c8885940f7876a07c8379f6416 2023-04-09 15:54:30,996 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/b99122fef427461fa9fedb4d387e8033 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/b99122fef427461fa9fedb4d387e8033 2023-04-09 15:54:30,997 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/5f75a0e7f118421bb87bfa24afcc45d1 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/5f75a0e7f118421bb87bfa24afcc45d1 2023-04-09 15:54:30,998 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/83326a2e5d03411fb5374bcfa2995b4f to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/83326a2e5d03411fb5374bcfa2995b4f 2023-04-09 15:54:30,999 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/290c5385c1ca40f2b53ce9a5c965ed56 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/290c5385c1ca40f2b53ce9a5c965ed56 2023-04-09 15:54:31,000 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/ca59f3bdf5f5443299701f5885ad3730 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/ca59f3bdf5f5443299701f5885ad3730 2023-04-09 15:54:31,002 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/25ad6d9aa6d24befab989da9cf067f19 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/25ad6d9aa6d24befab989da9cf067f19 2023-04-09 15:54:31,004 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/855de20f6c5546078352e88f9a3d9ed4 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/855de20f6c5546078352e88f9a3d9ed4 2023-04-09 15:54:31,007 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/338bcd2f2d09414e8b62d8d99cf35c32 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/338bcd2f2d09414e8b62d8d99cf35c32 2023-04-09 15:54:31,008 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/bfced28380a1463285137c78e8b389a5_SeqId_44_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/bfced28380a1463285137c78e8b389a5_SeqId_44_ 2023-04-09 15:54:31,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-04-09 15:54:31,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:31,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:31,021 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 0106df3526238973fff1bd090829f995 to self. 2023-04-09 15:54:31,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0106df3526238973fff1bd090829f995 2023-04-09 15:54:31,024 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=0106df3526238973fff1bd090829f995, regionState=CLOSED 2023-04-09 15:54:31,024 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1681055671024"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055671024"}]},"ts":"1681055671024"} 2023-04-09 15:54:31,027 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-04-09 15:54:31,027 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 0106df3526238973fff1bd090829f995, server=jenkins-hbase4.apache.org,44869,1681055618167 in 201 msec 2023-04-09 15:54:31,028 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0106df3526238973fff1bd090829f995, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=true 2023-04-09 15:54:31,179 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=0106df3526238973fff1bd090829f995, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:31,179 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1681055671179"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055671179"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055671179"}]},"ts":"1681055671179"} 2023-04-09 15:54:31,181 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 0106df3526238973fff1bd090829f995, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:31,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:31,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0106df3526238973fff1bd090829f995, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.', STARTKEY => '', ENDKEY => ''} 2023-04-09 15:54:31,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 0106df3526238973fff1bd090829f995 2023-04-09 15:54:31,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:31,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0106df3526238973fff1bd090829f995 2023-04-09 15:54:31,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0106df3526238973fff1bd090829f995 2023-04-09 15:54:31,338 INFO [StoreOpener-0106df3526238973fff1bd090829f995-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0106df3526238973fff1bd090829f995 2023-04-09 15:54:31,339 DEBUG [StoreOpener-0106df3526238973fff1bd090829f995-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1 2023-04-09 15:54:31,339 DEBUG [StoreOpener-0106df3526238973fff1bd090829f995-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1 2023-04-09 15:54:31,339 INFO [StoreOpener-0106df3526238973fff1bd090829f995-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0106df3526238973fff1bd090829f995 columnFamilyName family1 2023-04-09 15:54:31,345 DEBUG [StoreOpener-0106df3526238973fff1bd090829f995-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/2424c305975e46ee8a8d3f82e3c53128_SeqId_46_ 2023-04-09 15:54:31,351 DEBUG [StoreOpener-0106df3526238973fff1bd090829f995-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/68015ee8be1640f391ce79f7b8890796 2023-04-09 15:54:31,358 DEBUG [StoreOpener-0106df3526238973fff1bd090829f995-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/f69af19a357644da99b720426db2b7d5 2023-04-09 15:54:31,359 INFO [StoreOpener-0106df3526238973fff1bd090829f995-1] regionserver.HStore(310): Store=0106df3526238973fff1bd090829f995/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:31,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995 2023-04-09 15:54:31,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995 2023-04-09 15:54:31,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0106df3526238973fff1bd090829f995 2023-04-09 15:54:31,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0106df3526238973fff1bd090829f995; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68962920, jitterRate=0.02762758731842041}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-09 15:54:31,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:31,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995., pid=47, masterSystemTime=1681055671332 2023-04-09 15:54:31,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:31,370 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-04-09 15:54:31,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:31,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:31,372 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-04-09 15:54:31,372 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=0106df3526238973fff1bd090829f995, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:31,372 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1912): 0106df3526238973fff1bd090829f995/family1 is initiating minor compaction (all files) 2023-04-09 15:54:31,372 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0106df3526238973fff1bd090829f995/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:31,372 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1681055671372"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055671372"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055671372"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055671372"}]},"ts":"1681055671372"} 2023-04-09 15:54:31,372 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/f69af19a357644da99b720426db2b7d5, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/68015ee8be1640f391ce79f7b8890796, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/2424c305975e46ee8a8d3f82e3c53128_SeqId_46_] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp, totalSize=390.1 K 2023-04-09 15:54:31,376 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting f69af19a357644da99b720426db2b7d5, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842473 2023-04-09 15:54:31,377 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 68015ee8be1640f391ce79f7b8890796, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242473 2023-04-09 15:54:31,377 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 2424c305975e46ee8a8d3f82e3c53128_SeqId_46_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878842473 2023-04-09 15:54:31,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-04-09 15:54:31,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 0106df3526238973fff1bd090829f995, server=jenkins-hbase4.apache.org,44869,1681055618167 in 193 msec 2023-04-09 15:54:31,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-04-09 15:54:31,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0106df3526238973fff1bd090829f995, REOPEN/MOVE in 560 msec 2023-04-09 15:54:31,382 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-04-09 15:54:31,382 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 574 msec 2023-04-09 15:54:31,384 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 596 msec 2023-04-09 15:54:31,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-04-09 15:54:31,387 INFO [Listener at localhost/39283] compactions.TestMobCompactor(278): alter status finished 2023-04-09 15:54:31,388 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33617] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:31,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-04-09 15:54:31,391 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-04-09 15:54:31,392 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1681056271392 2023-04-09 15:54:31,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:31,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-09 15:54:31,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-04-09 15:54:31,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-09 15:54:31,395 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] zookeeper.ReadOnlyZKClient(139): Connect 0x2e596546 to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:54:31,418 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0106df3526238973fff1bd090829f995#family1#compaction#61 average throughput is 6.69 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:54:31,445 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13cb6812, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:54:31,445 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:31,445 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:31,445 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:31,445 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:31,445 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:31,488 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280d1559a668664265ad137bddc50bf263 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511280d1559a668664265ad137bddc50bf263 2023-04-09 15:54:31,489 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-09 15:54:31,506 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:54:31,508 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:54:31,515 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-09 15:54:31,518 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-09 15:54:31,531 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d39bae220e4b4654a0f0e0af1773497a first=Optional[r05] last=Optional[r8] 2023-04-09 15:54:31,534 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=50 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d39bae220e4b4654a0f0e0af1773497a}] 2023-04-09 15:54:31,539 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d39bae220e4b4654a0f0e0af1773497a for inclusion in 0106df3526238973fff1bd090829f995/family1 2023-04-09 15:54:31,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-04-09 15:54:31,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:54:31,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:31,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d39bae220e4b4654a0f0e0af1773497a to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7fgvg6nel9q31rj2vknd08mmcduo6t36fnp1v0s7baa9ok2nia4rj3m610p2vcu6/family1/d39bae220e4b4654a0f0e0af1773497a 2023-04-09 15:54:31,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7fgvg6nel9q31rj2vknd08mmcduo6t36fnp1v0s7baa9ok2nia4rj3m610p2vcu6/family1/d39bae220e4b4654a0f0e0af1773497a as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/24384e8ad07c4832858a81b7e76543a1_SeqId_52_ 2023-04-09 15:54:31,552 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7fgvg6nel9q31rj2vknd08mmcduo6t36fnp1v0s7baa9ok2nia4rj3m610p2vcu6/family1/d39bae220e4b4654a0f0e0af1773497a into 0106df3526238973fff1bd090829f995/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/24384e8ad07c4832858a81b7e76543a1_SeqId_52_ - updating store file list. 2023-04-09 15:54:31,566 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/24384e8ad07c4832858a81b7e76543a1_SeqId_52_ into 0106df3526238973fff1bd090829f995/family1 2023-04-09 15:54:31,566 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7fgvg6nel9q31rj2vknd08mmcduo6t36fnp1v0s7baa9ok2nia4rj3m610p2vcu6/family1/d39bae220e4b4654a0f0e0af1773497a into 0106df3526238973fff1bd090829f995/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/24384e8ad07c4832858a81b7e76543a1_SeqId_52_) 2023-04-09 15:54:31,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7fgvg6nel9q31rj2vknd08mmcduo6t36fnp1v0s7baa9ok2nia4rj3m610p2vcu6/family1/d39bae220e4b4654a0f0e0af1773497a 2023-04-09 15:54:31,570 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-09 15:54:31,571 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:31,573 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112038b75ff1cc3e4b1d9f71ac277752cbde to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112038b75ff1cc3e4b1d9f71ac277752cbde 2023-04-09 15:54:31,574 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128a0ff61bd89eb44fa841616872c40cb16 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128a0ff61bd89eb44fa841616872c40cb16 2023-04-09 15:54:31,574 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-04-09 15:54:31,574 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-04-09 15:54:31,575 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:31,575 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:31,575 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:31,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-09 15:54:31,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:31,576 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-04-09 15:54:31,578 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 187 msec 2023-04-09 15:54:31,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-04-09 15:54:31,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:32,078 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-04-09 15:54:32,079 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-04-09 15:54:32,080 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-04-09 15:54:32,082 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-04-09 15:54:32,086 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0106df3526238973fff1bd090829f995, REOPEN/MOVE}] 2023-04-09 15:54:32,086 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0106df3526238973fff1bd090829f995, REOPEN/MOVE 2023-04-09 15:54:32,087 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=0106df3526238973fff1bd090829f995, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:32,087 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1681055672087"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055672087"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055672087"}]},"ts":"1681055672087"} 2023-04-09 15:54:32,089 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 0106df3526238973fff1bd090829f995, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:32,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0106df3526238973fff1bd090829f995 2023-04-09 15:54:32,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0106df3526238973fff1bd090829f995, disabling compactions & flushes 2023-04-09 15:54:32,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:32,669 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/.tmp/family1/64a25bb470ca45c3bbe235c621602e0e as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/64a25bb470ca45c3bbe235c621602e0e 2023-04-09 15:54:32,675 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0106df3526238973fff1bd090829f995/family1 of 0106df3526238973fff1bd090829f995 into 64a25bb470ca45c3bbe235c621602e0e(size=193.0 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-09 15:54:32,675 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:32,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:32,675 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995., storeName=0106df3526238973fff1bd090829f995/family1, priority=13, startTime=1681055671369; duration=1sec 2023-04-09 15:54:32,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:32,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. after waiting 0 ms 2023-04-09 15:54:32,675 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:32,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:32,675 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/f69af19a357644da99b720426db2b7d5, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/68015ee8be1640f391ce79f7b8890796, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/2424c305975e46ee8a8d3f82e3c53128_SeqId_46_] to archive 2023-04-09 15:54:32,676 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:32,678 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/f69af19a357644da99b720426db2b7d5 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/f69af19a357644da99b720426db2b7d5 2023-04-09 15:54:32,679 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/68015ee8be1640f391ce79f7b8890796 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/68015ee8be1640f391ce79f7b8890796 2023-04-09 15:54:32,681 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/2424c305975e46ee8a8d3f82e3c53128_SeqId_46_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/2424c305975e46ee8a8d3f82e3c53128_SeqId_46_ 2023-04-09 15:54:32,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-04-09 15:54:32,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:32,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:32,689 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 0106df3526238973fff1bd090829f995 to self. 2023-04-09 15:54:32,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0106df3526238973fff1bd090829f995 2023-04-09 15:54:32,691 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=0106df3526238973fff1bd090829f995, regionState=CLOSED 2023-04-09 15:54:32,691 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1681055672691"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055672691"}]},"ts":"1681055672691"} 2023-04-09 15:54:32,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-04-09 15:54:32,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 0106df3526238973fff1bd090829f995, server=jenkins-hbase4.apache.org,44869,1681055618167 in 603 msec 2023-04-09 15:54:32,694 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0106df3526238973fff1bd090829f995, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=true 2023-04-09 15:54:32,845 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=0106df3526238973fff1bd090829f995, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:32,845 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1681055672845"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055672845"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055672845"}]},"ts":"1681055672845"} 2023-04-09 15:54:32,847 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 0106df3526238973fff1bd090829f995, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:33,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:33,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0106df3526238973fff1bd090829f995, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.', STARTKEY => '', ENDKEY => ''} 2023-04-09 15:54:33,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 0106df3526238973fff1bd090829f995 2023-04-09 15:54:33,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:33,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0106df3526238973fff1bd090829f995 2023-04-09 15:54:33,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0106df3526238973fff1bd090829f995 2023-04-09 15:54:33,004 INFO [StoreOpener-0106df3526238973fff1bd090829f995-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0106df3526238973fff1bd090829f995 2023-04-09 15:54:33,005 DEBUG [StoreOpener-0106df3526238973fff1bd090829f995-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1 2023-04-09 15:54:33,005 DEBUG [StoreOpener-0106df3526238973fff1bd090829f995-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1 2023-04-09 15:54:33,005 INFO [StoreOpener-0106df3526238973fff1bd090829f995-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0106df3526238973fff1bd090829f995 columnFamilyName family1 2023-04-09 15:54:33,012 DEBUG [StoreOpener-0106df3526238973fff1bd090829f995-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/24384e8ad07c4832858a81b7e76543a1_SeqId_52_ 2023-04-09 15:54:33,016 DEBUG [StoreOpener-0106df3526238973fff1bd090829f995-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/family1/64a25bb470ca45c3bbe235c621602e0e 2023-04-09 15:54:33,016 INFO [StoreOpener-0106df3526238973fff1bd090829f995-1] regionserver.HStore(310): Store=0106df3526238973fff1bd090829f995/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:33,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995 2023-04-09 15:54:33,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995 2023-04-09 15:54:33,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0106df3526238973fff1bd090829f995 2023-04-09 15:54:33,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0106df3526238973fff1bd090829f995; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58950311, jitterRate=-0.12157191336154938}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-09 15:54:33,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:54:33,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995., pid=53, masterSystemTime=1681055672999 2023-04-09 15:54:33,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:33,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:54:33,026 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=0106df3526238973fff1bd090829f995, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:33,026 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1681055673026"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055673026"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055673026"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055673026"}]},"ts":"1681055673026"} 2023-04-09 15:54:33,030 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-04-09 15:54:33,030 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 0106df3526238973fff1bd090829f995, server=jenkins-hbase4.apache.org,44869,1681055618167 in 181 msec 2023-04-09 15:54:33,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-04-09 15:54:33,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0106df3526238973fff1bd090829f995, REOPEN/MOVE in 944 msec 2023-04-09 15:54:33,037 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-04-09 15:54:33,037 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 950 msec 2023-04-09 15:54:33,039 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.3730 sec 2023-04-09 15:54:33,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-04-09 15:54:33,042 INFO [Listener at localhost/39283] compactions.TestMobCompactor(278): alter status finished 2023-04-09 15:54:33,042 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33617] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-04-09 15:54:33,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-04-09 15:54:33,045 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-04-09 15:54:33,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:33,046 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1681056273046 2023-04-09 15:54:33,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-09 15:54:33,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-04-09 15:54:33,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-09 15:54:33,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] zookeeper.ReadOnlyZKClient(139): Connect 0x52478fa8 to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:54:33,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a84e60a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:54:33,054 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:33,054 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:33,054 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:33,054 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:33,054 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:33,054 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:33,054 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:33,054 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-04-09 15:54:33,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-04-09 15:54:33,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:33,056 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-04-09 15:54:33,057 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 13 msec 2023-04-09 15:54:33,116 INFO [Listener at localhost/39283] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=260 (was 266), OpenFileDescriptor=629 (was 638), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=426 (was 401) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=1619 (was 1751) 2023-04-09 15:54:33,130 INFO [Listener at localhost/39283] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=260, OpenFileDescriptor=629, MaxFileDescriptor=60000, SystemLoadAverage=426, ProcessCount=169, AvailableMemoryMB=1618 2023-04-09 15:54:33,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-04-09 15:54:33,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:33,135 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-04-09 15:54:33,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-04-09 15:54:33,136 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-09 15:54:33,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-04-09 15:54:33,138 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788 2023-04-09 15:54:33,140 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788 empty. 2023-04-09 15:54:33,141 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788 2023-04-09 15:54:33,141 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-04-09 15:54:33,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-04-09 15:54:33,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-04-09 15:54:33,552 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-04-09 15:54:33,553 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => f956cf1b99eed391208338072bc13788, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:54:33,559 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:33,559 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing f956cf1b99eed391208338072bc13788, disabling compactions & flushes 2023-04-09 15:54:33,559 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:33,559 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:33,559 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. after waiting 0 ms 2023-04-09 15:54:33,559 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:33,559 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:33,559 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:33,562 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-04-09 15:54:33,563 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1681055673562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055673562"}]},"ts":"1681055673562"} 2023-04-09 15:54:33,564 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-04-09 15:54:33,565 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-09 15:54:33,565 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055673565"}]},"ts":"1681055673565"} 2023-04-09 15:54:33,567 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-04-09 15:54:33,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f956cf1b99eed391208338072bc13788, ASSIGN}] 2023-04-09 15:54:33,572 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f956cf1b99eed391208338072bc13788, ASSIGN 2023-04-09 15:54:33,574 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f956cf1b99eed391208338072bc13788, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:54:33,725 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=f956cf1b99eed391208338072bc13788, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:33,725 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1681055673725"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055673725"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055673725"}]},"ts":"1681055673725"} 2023-04-09 15:54:33,727 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure f956cf1b99eed391208338072bc13788, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:33,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-04-09 15:54:33,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:33,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f956cf1b99eed391208338072bc13788, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.', STARTKEY => '', ENDKEY => ''} 2023-04-09 15:54:33,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily f956cf1b99eed391208338072bc13788 2023-04-09 15:54:33,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:33,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f956cf1b99eed391208338072bc13788 2023-04-09 15:54:33,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f956cf1b99eed391208338072bc13788 2023-04-09 15:54:33,883 INFO [StoreOpener-f956cf1b99eed391208338072bc13788-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f956cf1b99eed391208338072bc13788 2023-04-09 15:54:33,885 DEBUG [StoreOpener-f956cf1b99eed391208338072bc13788-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1 2023-04-09 15:54:33,885 DEBUG [StoreOpener-f956cf1b99eed391208338072bc13788-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1 2023-04-09 15:54:33,885 INFO [StoreOpener-f956cf1b99eed391208338072bc13788-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f956cf1b99eed391208338072bc13788 columnFamilyName family1 2023-04-09 15:54:33,887 INFO [StoreOpener-f956cf1b99eed391208338072bc13788-1] regionserver.HStore(310): Store=f956cf1b99eed391208338072bc13788/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:33,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788 2023-04-09 15:54:33,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788 2023-04-09 15:54:33,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f956cf1b99eed391208338072bc13788 2023-04-09 15:54:33,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:54:33,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f956cf1b99eed391208338072bc13788; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60988954, jitterRate=-0.09119376540184021}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-09 15:54:33,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:33,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788., pid=57, masterSystemTime=1681055673879 2023-04-09 15:54:33,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:33,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:33,900 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=f956cf1b99eed391208338072bc13788, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:33,900 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1681055673899"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055673899"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055673899"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055673899"}]},"ts":"1681055673899"} 2023-04-09 15:54:33,903 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-04-09 15:54:33,903 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure f956cf1b99eed391208338072bc13788, server=jenkins-hbase4.apache.org,44869,1681055618167 in 174 msec 2023-04-09 15:54:33,906 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-04-09 15:54:33,906 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f956cf1b99eed391208338072bc13788, ASSIGN in 333 msec 2023-04-09 15:54:33,907 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-09 15:54:33,907 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055673907"}]},"ts":"1681055673907"} 2023-04-09 15:54:33,910 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-04-09 15:54:33,912 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-04-09 15:54:33,914 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 779 msec 2023-04-09 15:54:34,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-04-09 15:54:34,241 INFO [Listener at localhost/39283] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-04-09 15:54:34,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:34,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:34,274 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:34,274 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:34,274 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-09 15:54:34,274 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-09 15:54:34,275 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:34,275 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:34,277 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:34,277 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:34,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:34,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:34,277 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:34,277 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:34,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:34,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:34,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:34,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:34,278 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:34,280 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:34,280 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-09 15:54:34,280 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:34,280 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-09 15:54:34,282 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:34,282 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:34,282 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:34,282 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. started... 2023-04-09 15:54:34,283 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f956cf1b99eed391208338072bc13788 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-04-09 15:54:34,289 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:34,723 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113070e4f58d7aaa4d1bbff9736959dd687d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113070e4f58d7aaa4d1bbff9736959dd687d 2023-04-09 15:54:35,127 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/2d18b088a079488cbd8a0863bd1af8be 2023-04-09 15:54:35,132 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/2d18b088a079488cbd8a0863bd1af8be as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/2d18b088a079488cbd8a0863bd1af8be 2023-04-09 15:54:35,137 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/2d18b088a079488cbd8a0863bd1af8be, entries=1000, sequenceid=5, filesize=190.5 K 2023-04-09 15:54:35,137 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f956cf1b99eed391208338072bc13788 in 854ms, sequenceid=5, compaction requested=false 2023-04-09 15:54:35,138 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:35,138 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:35,138 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:35,138 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:35,138 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,139 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-09 15:54:35,139 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-09 15:54:35,142 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,142 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:35,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:35,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:35,143 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,143 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:35,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:35,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:35,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-09 15:54:35,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b251b10[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:35,145 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-09 15:54:35,145 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,146 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,147 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-09 15:54:35,147 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-09 15:54:35,147 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:35,147 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,147 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:35,148 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,148 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-09 15:54:35,148 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:35,148 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-09 15:54:35,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:35,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:35,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:35,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:35,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:35,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:35,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-09 15:54:35,157 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-09 15:54:35,157 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:35,157 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:35,157 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,157 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:35,159 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,159 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:35,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:35,159 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:35,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,159 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:35,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:35,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:35,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:35,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,161 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:35,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,166 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,166 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,166 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,166 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,166 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,166 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,166 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-09 15:54:35,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:35,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:35,166 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:35,166 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:35,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:35,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:35,167 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:35,167 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:35,167 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:35,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:35,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:35,267 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:35,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:35,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:35,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:35,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,275 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:35,275 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:35,275 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-09 15:54:35,275 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-09 15:54:35,275 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,275 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,277 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,277 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:35,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:35,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:35,277 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,277 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:35,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:35,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,278 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,278 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-04-09 15:54:35,278 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,278 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-09 15:54:35,278 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:35,278 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-09 15:54:35,279 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:35,279 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:35,279 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:35,279 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. started... 2023-04-09 15:54:35,279 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f956cf1b99eed391208338072bc13788 1/1 column families, dataSize=74 B heapSize=408 B 2023-04-09 15:54:35,692 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112868de5650f07f4e58b351e0945628dcfb to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112868de5650f07f4e58b351e0945628dcfb 2023-04-09 15:54:35,699 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/ace233f904164476a64dd2a6d846b602 2023-04-09 15:54:35,703 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/ace233f904164476a64dd2a6d846b602 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/ace233f904164476a64dd2a6d846b602 2023-04-09 15:54:35,708 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/ace233f904164476a64dd2a6d846b602, entries=1, sequenceid=9, filesize=5.0 K 2023-04-09 15:54:35,709 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f956cf1b99eed391208338072bc13788 in 430ms, sequenceid=9, compaction requested=false 2023-04-09 15:54:35,709 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:35,709 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:35,709 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:35,709 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:35,709 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,710 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-09 15:54:35,710 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-09 15:54:35,711 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,711 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:35,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:35,712 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:35,712 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:35,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:35,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:35,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-09 15:54:35,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@251a53[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:35,714 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-09 15:54:35,714 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,715 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,715 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-09 15:54:35,715 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-09 15:54:35,715 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:35,715 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,715 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:35,717 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-09 15:54:35,717 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,717 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:35,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:35,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:35,717 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-09 15:54:35,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:35,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:35,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:35,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:35,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-09 15:54:35,719 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-09 15:54:35,719 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:35,719 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:35,720 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,720 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:35,721 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,721 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,721 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:35,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:35,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:35,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:35,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:35,721 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:35,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:35,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,723 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:35,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,725 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,725 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:35,725 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,725 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:35,725 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:35,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:35,725 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:35,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:35,725 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-09 15:54:35,725 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,725 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:35,726 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,726 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,726 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:35,726 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:35,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:35,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:35,826 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:35,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:35,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:35,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:35,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,833 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:35,833 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:35,833 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-09 15:54:35,833 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-09 15:54:35,833 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,833 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,834 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:35,834 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:35,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:35,835 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:35,835 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:35,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:35,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,836 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,836 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-04-09 15:54:35,836 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:35,836 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-09 15:54:35,836 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:35,836 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-09 15:54:35,836 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:35,836 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:35,836 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:35,836 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. started... 2023-04-09 15:54:35,836 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f956cf1b99eed391208338072bc13788 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:36,263 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201f4dab46ef19241048733e95d1c98ea97 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201f4dab46ef19241048733e95d1c98ea97 2023-04-09 15:54:36,522 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-09 15:54:36,669 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/33c06eae864d4c37b62875d167639014 2023-04-09 15:54:36,674 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/33c06eae864d4c37b62875d167639014 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/33c06eae864d4c37b62875d167639014 2023-04-09 15:54:36,679 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/33c06eae864d4c37b62875d167639014, entries=1, sequenceid=13, filesize=5.0 K 2023-04-09 15:54:36,679 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f956cf1b99eed391208338072bc13788 in 843ms, sequenceid=13, compaction requested=true 2023-04-09 15:54:36,680 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:36,680 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:36,680 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:36,680 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:36,680 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,680 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-09 15:54:36,680 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-09 15:54:36,682 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,682 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:36,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:36,683 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,683 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:36,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:36,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:36,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:36,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-09 15:54:36,684 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-09 15:54:36,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77b81393[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:36,684 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,685 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,686 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-09 15:54:36,686 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-09 15:54:36,686 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:36,686 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,686 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:36,687 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-09 15:54:36,687 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,687 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:36,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:36,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:36,687 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-09 15:54:36,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:36,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:36,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:36,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:36,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-09 15:54:36,689 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-09 15:54:36,690 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:36,690 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:36,690 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,690 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:36,691 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,691 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:36,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:36,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,691 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:36,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:36,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:36,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:36,692 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:36,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,693 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:36,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,697 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,697 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,697 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:36,697 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:36,697 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,697 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:36,697 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:36,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:36,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:36,697 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:36,697 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,697 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-09 15:54:36,697 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:36,697 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:36,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:36,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:36,798 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:36,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:36,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:36,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:36,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,804 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:36,804 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:36,804 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-09 15:54:36,804 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-09 15:54:36,805 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,805 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,806 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:36,806 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:36,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:36,806 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,806 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:36,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,807 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,807 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-04-09 15:54:36,807 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,808 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-09 15:54:36,808 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:36,808 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-09 15:54:36,808 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:36,808 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:36,808 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:36,808 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. started... 2023-04-09 15:54:36,808 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f956cf1b99eed391208338072bc13788 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:36,822 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205596f4fbd0482412d841d4a2abdee29e2 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205596f4fbd0482412d841d4a2abdee29e2 2023-04-09 15:54:36,828 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/ed9866cb70304b468b09369930d7e3df 2023-04-09 15:54:36,832 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/ed9866cb70304b468b09369930d7e3df as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/ed9866cb70304b468b09369930d7e3df 2023-04-09 15:54:36,836 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/ed9866cb70304b468b09369930d7e3df, entries=1, sequenceid=17, filesize=5.0 K 2023-04-09 15:54:36,837 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f956cf1b99eed391208338072bc13788 in 29ms, sequenceid=17, compaction requested=true 2023-04-09 15:54:36,837 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:36,837 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:36,837 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:36,837 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:36,837 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,838 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-09 15:54:36,838 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-09 15:54:36,839 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,839 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:36,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:36,848 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,848 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:36,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:36,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:36,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:36,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-09 15:54:36,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@154f272a[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:36,850 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-09 15:54:36,850 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,851 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,851 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-09 15:54:36,851 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-09 15:54:36,851 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:36,851 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,851 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:36,856 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,856 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-09 15:54:36,856 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:36,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:36,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:36,856 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-09 15:54:36,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:36,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:36,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:36,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:36,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-09 15:54:36,860 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-09 15:54:36,860 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:36,860 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:36,860 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,860 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:36,862 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,862 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,862 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:36,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:36,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:36,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:36,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:36,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:36,864 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:36,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,865 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:36,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,868 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:36,868 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:36,868 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:36,868 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:36,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:36,868 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,868 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,868 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,868 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-09 15:54:36,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:36,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:36,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:36,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:36,868 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,869 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,869 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:36,869 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:36,969 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:36,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:36,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:36,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:36,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,978 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:36,978 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:36,978 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-09 15:54:36,978 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-09 15:54:36,979 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,979 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,980 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:36,980 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:36,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:36,980 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:36,980 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:36,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:36,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,981 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,981 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-04-09 15:54:36,981 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:36,981 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-09 15:54:36,981 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:36,981 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-09 15:54:36,982 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:36,982 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:36,982 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:36,982 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. started... 2023-04-09 15:54:36,982 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f956cf1b99eed391208338072bc13788 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:37,395 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122871d203f1f8ee46b394585d0c5de5547b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122871d203f1f8ee46b394585d0c5de5547b 2023-04-09 15:54:37,401 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/74e611b716a34a9c98455cd20d5b8055 2023-04-09 15:54:37,406 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/74e611b716a34a9c98455cd20d5b8055 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/74e611b716a34a9c98455cd20d5b8055 2023-04-09 15:54:37,410 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/74e611b716a34a9c98455cd20d5b8055, entries=1, sequenceid=21, filesize=5.0 K 2023-04-09 15:54:37,411 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f956cf1b99eed391208338072bc13788 in 429ms, sequenceid=21, compaction requested=true 2023-04-09 15:54:37,411 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:37,411 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:37,412 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:37,412 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:37,412 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:37,412 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-09 15:54:37,412 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-09 15:54:37,415 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,415 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:37,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:37,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:37,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:37,415 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,415 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:37,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:37,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:37,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:37,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:37,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-09 15:54:37,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56715308[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:37,417 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-09 15:54:37,417 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,418 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,418 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-09 15:54:37,418 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-09 15:54:37,418 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:37,418 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:37,418 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:37,419 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-09 15:54:37,419 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:37,419 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-09 15:54:37,419 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:37,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:37,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:37,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:37,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:37,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:37,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:37,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:37,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:37,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:37,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-09 15:54:37,422 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-09 15:54:37,422 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:37,422 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:37,422 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,422 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:37,424 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,424 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:37,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:37,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,424 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:37,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,424 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:37,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:37,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:37,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:37,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:37,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,425 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:37,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:37,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:37,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:37,429 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:37,429 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:37,429 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:37,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-09 15:54:37,429 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:37,429 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:37,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:37,429 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:37,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:37,430 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:37,430 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:37,429 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,430 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:37,430 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:37,430 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:37,530 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:37,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:37,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:37,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:37,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,537 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:37,537 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:37,537 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-09 15:54:37,537 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-09 15:54:37,537 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,537 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,538 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:37,538 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:37,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:37,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:37,539 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:37,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,539 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:37,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:37,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,539 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,540 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-04-09 15:54:37,540 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:37,540 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-09 15:54:37,540 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:37,540 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-09 15:54:37,540 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:37,540 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:37,540 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:37,540 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. started... 2023-04-09 15:54:37,540 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f956cf1b99eed391208338072bc13788 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:37,954 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231455f4951b7b247bebb0461dd8eb3d0cf to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231455f4951b7b247bebb0461dd8eb3d0cf 2023-04-09 15:54:38,364 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/7bc2be8607374643bfee774eb400e20d 2023-04-09 15:54:38,369 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/7bc2be8607374643bfee774eb400e20d as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/7bc2be8607374643bfee774eb400e20d 2023-04-09 15:54:38,373 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/7bc2be8607374643bfee774eb400e20d, entries=1, sequenceid=25, filesize=5.0 K 2023-04-09 15:54:38,374 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f956cf1b99eed391208338072bc13788 in 834ms, sequenceid=25, compaction requested=true 2023-04-09 15:54:38,374 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:38,374 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:38,374 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:38,374 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:38,374 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:38,374 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-09 15:54:38,375 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-09 15:54:38,376 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:38,376 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:38,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:38,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:38,377 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,377 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:38,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:38,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:38,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:38,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:38,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-09 15:54:38,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7eae2c17[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:38,378 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-09 15:54:38,378 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,379 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,379 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-09 15:54:38,379 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-09 15:54:38,379 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:38,379 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:38,379 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:38,384 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-09 15:54:38,384 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:38,384 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:38,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:38,384 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-09 15:54:38,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:38,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:38,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:38,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:38,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:38,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:38,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:38,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:38,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-09 15:54:38,386 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-09 15:54:38,386 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:38,387 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:38,387 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,387 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:38,388 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,388 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,388 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:38,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:38,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:38,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:38,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:38,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:38,389 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:38,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:38,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:38,390 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:38,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:38,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:38,395 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:38,395 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,395 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,395 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:38,395 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:38,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:38,395 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:38,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-09 15:54:38,395 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:38,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:38,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:38,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:38,395 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,395 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,395 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:38,395 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:38,396 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:38,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:38,496 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:38,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:38,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:38,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:38,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,502 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:38,502 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:38,503 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-09 15:54:38,503 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-09 15:54:38,503 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,503 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,507 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:38,507 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:38,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:38,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:38,508 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:38,508 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:38,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:38,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,509 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,509 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-04-09 15:54:38,509 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:38,509 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-09 15:54:38,509 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:38,509 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-09 15:54:38,509 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:38,509 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:38,509 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:38,509 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. started... 2023-04-09 15:54:38,510 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f956cf1b99eed391208338072bc13788 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:38,923 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010142ecdfbb2f7c4163978fea41f5f3e00d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010142ecdfbb2f7c4163978fea41f5f3e00d 2023-04-09 15:54:39,340 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/03e6f1c261af46d88497764e2246477a 2023-04-09 15:54:39,345 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/03e6f1c261af46d88497764e2246477a as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/03e6f1c261af46d88497764e2246477a 2023-04-09 15:54:39,348 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/03e6f1c261af46d88497764e2246477a, entries=1, sequenceid=29, filesize=5.0 K 2023-04-09 15:54:39,349 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f956cf1b99eed391208338072bc13788 in 839ms, sequenceid=29, compaction requested=true 2023-04-09 15:54:39,349 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:39,349 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:39,349 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:39,349 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:39,349 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:39,349 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-09 15:54:39,349 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-09 15:54:39,351 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:39,351 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:39,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:39,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:39,351 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,351 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:39,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:39,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:39,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:39,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:39,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-09 15:54:39,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49bd8cda[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:39,352 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-09 15:54:39,353 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,354 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,354 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-09 15:54:39,354 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-09 15:54:39,354 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:39,354 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:39,354 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:39,355 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-09 15:54:39,355 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:39,355 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:39,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:39,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:39,355 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-09 15:54:39,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:39,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:39,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:39,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:39,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:39,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:39,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:39,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-09 15:54:39,357 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-09 15:54:39,357 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:39,357 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:39,357 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,357 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:39,362 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,362 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,362 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:39,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:39,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:39,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:39,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:39,363 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:39,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:39,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:39,364 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:39,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:39,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:39,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:39,366 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:39,366 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,366 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,366 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:39,366 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:39,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:39,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:39,366 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:39,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:39,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:39,366 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:39,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-09 15:54:39,366 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,366 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,366 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,366 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:39,366 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:39,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:39,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:39,466 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:39,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:39,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:39,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:39,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,472 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:39,472 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:39,472 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-09 15:54:39,472 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-09 15:54:39,472 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,473 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,474 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:39,474 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:39,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:39,474 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:39,474 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,475 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,475 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-04-09 15:54:39,475 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:39,475 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-09 15:54:39,475 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:39,475 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-09 15:54:39,475 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:39,475 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:39,475 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:39,475 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. started... 2023-04-09 15:54:39,475 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f956cf1b99eed391208338072bc13788 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:39,887 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010309f8eaf8c6a64aa193f95746fbb98fbb to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010309f8eaf8c6a64aa193f95746fbb98fbb 2023-04-09 15:54:40,292 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/072aca00fc854513b6ac3097e0593b33 2023-04-09 15:54:40,297 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/072aca00fc854513b6ac3097e0593b33 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/072aca00fc854513b6ac3097e0593b33 2023-04-09 15:54:40,301 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/072aca00fc854513b6ac3097e0593b33, entries=1, sequenceid=33, filesize=5.0 K 2023-04-09 15:54:40,302 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f956cf1b99eed391208338072bc13788 in 827ms, sequenceid=33, compaction requested=true 2023-04-09 15:54:40,302 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:40,302 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:40,302 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:40,302 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:40,302 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:40,302 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-09 15:54:40,302 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-09 15:54:40,305 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,305 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:40,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:40,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:40,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:40,305 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:40,305 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:40,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:40,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:40,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:40,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-09 15:54:40,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@252784b0[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:40,307 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-09 15:54:40,307 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,308 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,308 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-09 15:54:40,308 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-09 15:54:40,308 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:40,308 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:40,308 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:40,309 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-09 15:54:40,309 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:40,309 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:40,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:40,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:40,309 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-09 15:54:40,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:40,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:40,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:40,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:40,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:40,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:40,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:40,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-09 15:54:40,311 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-09 15:54:40,311 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:40,311 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:40,311 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,311 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:40,313 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,313 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,313 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:40,313 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:40,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,314 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:40,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:40,317 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:40,317 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:40,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:40,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:40,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:40,317 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:40,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:40,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:40,317 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:40,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:40,317 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:40,317 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,317 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:40,317 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,317 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,317 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:40,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-09 15:54:40,318 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,318 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:40,418 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:40,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:40,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:40,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:40,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,424 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:40,424 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:40,424 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-09 15:54:40,424 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-09 15:54:40,424 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,424 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,425 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:40,425 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:40,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:40,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:40,426 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:40,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,426 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:40,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:40,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,426 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,427 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-04-09 15:54:40,427 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:40,427 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-09 15:54:40,427 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:40,427 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-09 15:54:40,427 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:40,427 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:40,427 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:40,427 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. started... 2023-04-09 15:54:40,427 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f956cf1b99eed391208338072bc13788 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:40,841 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ec8a9398cb1d46bca81efafbdc6b0704 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907ec8a9398cb1d46bca81efafbdc6b0704 2023-04-09 15:54:41,247 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/bcbcadc3ae984ea0ac17b8a2ddc2e03b 2023-04-09 15:54:41,252 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/bcbcadc3ae984ea0ac17b8a2ddc2e03b as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/bcbcadc3ae984ea0ac17b8a2ddc2e03b 2023-04-09 15:54:41,257 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/bcbcadc3ae984ea0ac17b8a2ddc2e03b, entries=1, sequenceid=37, filesize=5.0 K 2023-04-09 15:54:41,258 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f956cf1b99eed391208338072bc13788 in 831ms, sequenceid=37, compaction requested=true 2023-04-09 15:54:41,258 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:41,258 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:41,258 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:41,258 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:41,258 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:41,259 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-09 15:54:41,259 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-09 15:54:41,261 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:41,261 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:41,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:41,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:41,261 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,261 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:41,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:41,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:41,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:41,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:41,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-09 15:54:41,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79126a0f[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:41,263 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-09 15:54:41,263 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,264 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,264 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-09 15:54:41,264 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-09 15:54:41,264 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:41,265 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:41,265 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:41,266 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-09 15:54:41,266 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:41,266 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:41,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:41,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:41,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:41,266 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-09 15:54:41,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:41,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:41,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:41,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:41,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:41,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:41,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-09 15:54:41,268 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-09 15:54:41,268 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:41,268 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:41,268 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,269 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:41,270 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,270 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:41,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,270 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:41,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:41,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:41,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:41,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:41,271 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:41,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:41,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,272 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:41,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:41,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:41,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:41,275 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:41,275 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:41,275 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,275 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:41,275 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:41,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:41,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:41,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:41,275 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:41,275 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:41,275 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,275 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,275 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:41,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-09 15:54:41,275 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:41,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:41,275 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:41,376 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:41,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:41,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:41,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:41,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,383 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:41,383 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:41,383 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-04-09 15:54:41,383 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-04-09 15:54:41,383 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,383 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,384 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:41,384 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:41,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:41,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:41,385 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:41,385 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:41,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,385 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:41,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,386 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,386 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-04-09 15:54:41,386 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:41,386 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-04-09 15:54:41,386 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:41,386 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-04-09 15:54:41,386 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:54:41,386 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:41,386 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:41,386 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. started... 2023-04-09 15:54:41,386 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f956cf1b99eed391208338072bc13788 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:54:41,800 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120ae72c2c5c4694755b3526c8944dd6e42 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120ae72c2c5c4694755b3526c8944dd6e42 2023-04-09 15:54:42,205 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/e9c2d656ee4642ec82a8a07bb5a74e47 2023-04-09 15:54:42,209 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/e9c2d656ee4642ec82a8a07bb5a74e47 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/e9c2d656ee4642ec82a8a07bb5a74e47 2023-04-09 15:54:42,213 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/e9c2d656ee4642ec82a8a07bb5a74e47, entries=1, sequenceid=41, filesize=5.0 K 2023-04-09 15:54:42,214 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f956cf1b99eed391208338072bc13788 in 828ms, sequenceid=41, compaction requested=true 2023-04-09 15:54:42,214 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:42,214 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:42,214 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:54:42,214 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:54:42,214 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:42,214 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-04-09 15:54:42,214 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-04-09 15:54:42,216 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,216 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:42,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:42,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:42,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:42,216 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,216 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:42,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:42,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:42,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:42,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:42,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-04-09 15:54:42,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76d33fae[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:42,217 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-04-09 15:54:42,217 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,218 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,219 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-04-09 15:54:42,219 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:42,219 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:42,219 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-04-09 15:54:42,219 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:42,221 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:42,221 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-04-09 15:54:42,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:42,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:42,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:42,221 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:42,221 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-04-09 15:54:42,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:42,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:42,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:42,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:42,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:42,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:42,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-04-09 15:54:42,223 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-04-09 15:54:42,223 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:42,223 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:42,223 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,223 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:42,224 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,224 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:42,224 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:42,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:42,225 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:42,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:42,226 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:42,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:42,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:42,228 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:42,228 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,228 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:42,228 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-04-09 15:54:42,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-04-09 15:54:42,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:42,228 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:42,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:42,228 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:42,228 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:42,228 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,228 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:42,228 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:42,228 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,228 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:42,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:42,328 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:42,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:42,330 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33617] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:42,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-04-09 15:54:42,332 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-04-09 15:54:42,333 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1681056282333 2023-04-09 15:54:42,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:42,335 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-09 15:54:42,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-04-09 15:54:42,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-09 15:54:42,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] zookeeper.ReadOnlyZKClient(139): Connect 0x03961fe9 to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:54:42,340 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ed3ab12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:54:42,341 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:42,789 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103162e98ad8a884e9ca18c73d78efe88bb to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103162e98ad8a884e9ca18c73d78efe88bb 2023-04-09 15:54:42,791 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-09 15:54:42,803 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:54:42,805 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:54:42,812 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-09 15:54:42,813 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-09 15:54:42,822 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3081d66a0b954adf9c660663ca0000c0 first=Optional[r3] last=Optional[r6] 2023-04-09 15:54:42,823 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3081d66a0b954adf9c660663ca0000c0}] 2023-04-09 15:54:42,827 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3081d66a0b954adf9c660663ca0000c0 for inclusion in f956cf1b99eed391208338072bc13788/family1 2023-04-09 15:54:42,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-04-09 15:54:42,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:54:42,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:42,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3081d66a0b954adf9c660663ca0000c0 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__otq1hk29bn0ubco89vc5gcb6hsuig0gs41thltcvnhnv0mcrjg8gleivd4vkvpmj/family1/3081d66a0b954adf9c660663ca0000c0 2023-04-09 15:54:42,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__otq1hk29bn0ubco89vc5gcb6hsuig0gs41thltcvnhnv0mcrjg8gleivd4vkvpmj/family1/3081d66a0b954adf9c660663ca0000c0 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/c558849c2f554c21bb2de332a47b9ef7_SeqId_44_ 2023-04-09 15:54:42,833 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__otq1hk29bn0ubco89vc5gcb6hsuig0gs41thltcvnhnv0mcrjg8gleivd4vkvpmj/family1/3081d66a0b954adf9c660663ca0000c0 into f956cf1b99eed391208338072bc13788/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/c558849c2f554c21bb2de332a47b9ef7_SeqId_44_ - updating store file list. 2023-04-09 15:54:42,837 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/c558849c2f554c21bb2de332a47b9ef7_SeqId_44_ into f956cf1b99eed391208338072bc13788/family1 2023-04-09 15:54:42,837 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__otq1hk29bn0ubco89vc5gcb6hsuig0gs41thltcvnhnv0mcrjg8gleivd4vkvpmj/family1/3081d66a0b954adf9c660663ca0000c0 into f956cf1b99eed391208338072bc13788/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/c558849c2f554c21bb2de332a47b9ef7_SeqId_44_) 2023-04-09 15:54:42,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__otq1hk29bn0ubco89vc5gcb6hsuig0gs41thltcvnhnv0mcrjg8gleivd4vkvpmj/family1/3081d66a0b954adf9c660663ca0000c0 2023-04-09 15:54:42,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-04-09 15:54:42,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-04-09 15:54:42,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(1912): f956cf1b99eed391208338072bc13788/family1 is initiating minor compaction 2023-04-09 15:54:42,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3eab1782; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:42,841 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f956cf1b99eed391208338072bc13788/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:42,841 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/ace233f904164476a64dd2a6d846b602, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/33c06eae864d4c37b62875d167639014, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/ed9866cb70304b468b09369930d7e3df, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/74e611b716a34a9c98455cd20d5b8055, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/7bc2be8607374643bfee774eb400e20d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/03e6f1c261af46d88497764e2246477a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/072aca00fc854513b6ac3097e0593b33, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/bcbcadc3ae984ea0ac17b8a2ddc2e03b, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/e9c2d656ee4642ec82a8a07bb5a74e47, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/c558849c2f554c21bb2de332a47b9ef7_SeqId_44_] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp, totalSize=50.3 K 2023-04-09 15:54:42,841 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting ace233f904164476a64dd2a6d846b602, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-04-09 15:54:42,842 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 33c06eae864d4c37b62875d167639014, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-04-09 15:54:42,842 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting ed9866cb70304b468b09369930d7e3df, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-04-09 15:54:42,842 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 74e611b716a34a9c98455cd20d5b8055, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-04-09 15:54:42,842 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 7bc2be8607374643bfee774eb400e20d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-04-09 15:54:42,842 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 03e6f1c261af46d88497764e2246477a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-04-09 15:54:42,842 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 072aca00fc854513b6ac3097e0593b33, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-04-09 15:54:42,842 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting bcbcadc3ae984ea0ac17b8a2ddc2e03b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-04-09 15:54:42,842 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting e9c2d656ee4642ec82a8a07bb5a74e47, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-04-09 15:54:42,842 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting c558849c2f554c21bb2de332a47b9ef7_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-04-09 15:54:42,843 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-09 15:54:42,844 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:42,846 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122871d203f1f8ee46b394585d0c5de5547b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122871d203f1f8ee46b394585d0c5de5547b 2023-04-09 15:54:42,847 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231455f4951b7b247bebb0461dd8eb3d0cf to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231455f4951b7b247bebb0461dd8eb3d0cf 2023-04-09 15:54:42,848 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010142ecdfbb2f7c4163978fea41f5f3e00d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010142ecdfbb2f7c4163978fea41f5f3e00d 2023-04-09 15:54:42,849 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010309f8eaf8c6a64aa193f95746fbb98fbb to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010309f8eaf8c6a64aa193f95746fbb98fbb 2023-04-09 15:54:42,849 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-04-09 15:54:42,849 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-04-09 15:54:42,850 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:42,850 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:42,850 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:42,850 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:42,850 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:42,850 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:42,850 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:42,850 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:42,866 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] throttle.PressureAwareThroughputController(145): f956cf1b99eed391208338072bc13788#family1#compaction#72 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-04-09 15:54:43,680 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/e463bb2236e643038f49fee7736e3307 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/e463bb2236e643038f49fee7736e3307 2023-04-09 15:54:43,685 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b057ece65f1547b2930b2f29fd896a98 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205b057ece65f1547b2930b2f29fd896a98 2023-04-09 15:54:43,686 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f956cf1b99eed391208338072bc13788/family1 of f956cf1b99eed391208338072bc13788 into e463bb2236e643038f49fee7736e3307(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:54:43,686 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:43,686 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-09 15:54:43,686 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1681055682841; duration=0sec 2023-04-09 15:54:43,686 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:43,710 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/5f4f6ec0bdc54e599e0287aeb72c11ae first=Optional[r00] last=Optional[r2] 2023-04-09 15:54:43,711 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/5f4f6ec0bdc54e599e0287aeb72c11ae}] 2023-04-09 15:54:43,713 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/5f4f6ec0bdc54e599e0287aeb72c11ae for inclusion in f956cf1b99eed391208338072bc13788/family1 2023-04-09 15:54:43,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-04-09 15:54:43,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:54:43,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:43,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/5f4f6ec0bdc54e599e0287aeb72c11ae to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cnev6cdgbbdfbd8fv1e2dl7tpjvechstlseskpns3on24tls2e4q7qgccsiitrjh/family1/5f4f6ec0bdc54e599e0287aeb72c11ae 2023-04-09 15:54:43,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cnev6cdgbbdfbd8fv1e2dl7tpjvechstlseskpns3on24tls2e4q7qgccsiitrjh/family1/5f4f6ec0bdc54e599e0287aeb72c11ae as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/2656b7c536de483e8fc9a9a074d5e046_SeqId_47_ 2023-04-09 15:54:43,720 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cnev6cdgbbdfbd8fv1e2dl7tpjvechstlseskpns3on24tls2e4q7qgccsiitrjh/family1/5f4f6ec0bdc54e599e0287aeb72c11ae into f956cf1b99eed391208338072bc13788/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/2656b7c536de483e8fc9a9a074d5e046_SeqId_47_ - updating store file list. 2023-04-09 15:54:43,724 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/2656b7c536de483e8fc9a9a074d5e046_SeqId_47_ into f956cf1b99eed391208338072bc13788/family1 2023-04-09 15:54:43,724 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cnev6cdgbbdfbd8fv1e2dl7tpjvechstlseskpns3on24tls2e4q7qgccsiitrjh/family1/5f4f6ec0bdc54e599e0287aeb72c11ae into f956cf1b99eed391208338072bc13788/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/2656b7c536de483e8fc9a9a074d5e046_SeqId_47_) 2023-04-09 15:54:43,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cnev6cdgbbdfbd8fv1e2dl7tpjvechstlseskpns3on24tls2e4q7qgccsiitrjh/family1/5f4f6ec0bdc54e599e0287aeb72c11ae 2023-04-09 15:54:43,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-04-09 15:54:43,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-04-09 15:54:43,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(1912): f956cf1b99eed391208338072bc13788/family1 is initiating minor compaction (all files) 2023-04-09 15:54:43,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@bd4e0c1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:43,726 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f956cf1b99eed391208338072bc13788/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:43,726 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/2d18b088a079488cbd8a0863bd1af8be, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/e463bb2236e643038f49fee7736e3307, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/2656b7c536de483e8fc9a9a074d5e046_SeqId_47_] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp, totalSize=388.1 K 2023-04-09 15:54:43,726 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 2d18b088a079488cbd8a0863bd1af8be, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842473 2023-04-09 15:54:43,727 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting e463bb2236e643038f49fee7736e3307, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242473 2023-04-09 15:54:43,727 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 2656b7c536de483e8fc9a9a074d5e046_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878842473 2023-04-09 15:54:43,727 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-09 15:54:43,728 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:43,729 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113070e4f58d7aaa4d1bbff9736959dd687d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113070e4f58d7aaa4d1bbff9736959dd687d 2023-04-09 15:54:43,730 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201f4dab46ef19241048733e95d1c98ea97 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201f4dab46ef19241048733e95d1c98ea97 2023-04-09 15:54:43,731 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205596f4fbd0482412d841d4a2abdee29e2 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205596f4fbd0482412d841d4a2abdee29e2 2023-04-09 15:54:43,731 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-04-09 15:54:43,731 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-04-09 15:54:43,732 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:43,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-09 15:54:43,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:43,733 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-04-09 15:54:43,734 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.4020 sec 2023-04-09 15:54:43,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/ace233f904164476a64dd2a6d846b602, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/33c06eae864d4c37b62875d167639014, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/ed9866cb70304b468b09369930d7e3df, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/74e611b716a34a9c98455cd20d5b8055, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/7bc2be8607374643bfee774eb400e20d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/03e6f1c261af46d88497764e2246477a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/072aca00fc854513b6ac3097e0593b33, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/bcbcadc3ae984ea0ac17b8a2ddc2e03b, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/e9c2d656ee4642ec82a8a07bb5a74e47, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/c558849c2f554c21bb2de332a47b9ef7_SeqId_44_] to archive 2023-04-09 15:54:43,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:43,740 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/ace233f904164476a64dd2a6d846b602 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/ace233f904164476a64dd2a6d846b602 2023-04-09 15:54:43,741 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/33c06eae864d4c37b62875d167639014 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/33c06eae864d4c37b62875d167639014 2023-04-09 15:54:43,742 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/ed9866cb70304b468b09369930d7e3df to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/ed9866cb70304b468b09369930d7e3df 2023-04-09 15:54:43,743 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/74e611b716a34a9c98455cd20d5b8055 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/74e611b716a34a9c98455cd20d5b8055 2023-04-09 15:54:43,743 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] throttle.PressureAwareThroughputController(145): f956cf1b99eed391208338072bc13788#family1#compaction#73 average throughput is 22.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-04-09 15:54:43,744 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/7bc2be8607374643bfee774eb400e20d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/7bc2be8607374643bfee774eb400e20d 2023-04-09 15:54:43,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/03e6f1c261af46d88497764e2246477a to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/03e6f1c261af46d88497764e2246477a 2023-04-09 15:54:43,746 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/072aca00fc854513b6ac3097e0593b33 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/072aca00fc854513b6ac3097e0593b33 2023-04-09 15:54:43,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/bcbcadc3ae984ea0ac17b8a2ddc2e03b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/bcbcadc3ae984ea0ac17b8a2ddc2e03b 2023-04-09 15:54:43,748 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/e9c2d656ee4642ec82a8a07bb5a74e47 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/e9c2d656ee4642ec82a8a07bb5a74e47 2023-04-09 15:54:43,749 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/c558849c2f554c21bb2de332a47b9ef7_SeqId_44_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/c558849c2f554c21bb2de332a47b9ef7_SeqId_44_ 2023-04-09 15:54:43,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-04-09 15:54:43,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:44,216 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-04-09 15:54:44,217 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-04-09 15:54:44,217 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-04-09 15:54:44,218 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-04-09 15:54:44,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f956cf1b99eed391208338072bc13788, REOPEN/MOVE}] 2023-04-09 15:54:44,221 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f956cf1b99eed391208338072bc13788, REOPEN/MOVE 2023-04-09 15:54:44,222 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=f956cf1b99eed391208338072bc13788, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:44,222 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1681055684222"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055684222"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055684222"}]},"ts":"1681055684222"} 2023-04-09 15:54:44,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure f956cf1b99eed391208338072bc13788, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:44,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f956cf1b99eed391208338072bc13788 2023-04-09 15:54:44,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f956cf1b99eed391208338072bc13788, disabling compactions & flushes 2023-04-09 15:54:44,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:44,573 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/.tmp/family1/956d4e1a58524496b359b61d1c4ea5ad as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/956d4e1a58524496b359b61d1c4ea5ad 2023-04-09 15:54:44,578 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f956cf1b99eed391208338072bc13788/family1 of f956cf1b99eed391208338072bc13788 into 956d4e1a58524496b359b61d1c4ea5ad(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:54:44,578 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:44,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:44,578 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1681055683725; duration=0sec 2023-04-09 15:54:44,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:44,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. after waiting 0 ms 2023-04-09 15:54:44,578 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:44,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:44,578 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/2d18b088a079488cbd8a0863bd1af8be, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/e463bb2236e643038f49fee7736e3307, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/2656b7c536de483e8fc9a9a074d5e046_SeqId_47_] to archive 2023-04-09 15:54:44,579 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:44,580 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/2d18b088a079488cbd8a0863bd1af8be to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/2d18b088a079488cbd8a0863bd1af8be 2023-04-09 15:54:44,581 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/e463bb2236e643038f49fee7736e3307 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/e463bb2236e643038f49fee7736e3307 2023-04-09 15:54:44,582 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/2656b7c536de483e8fc9a9a074d5e046_SeqId_47_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/2656b7c536de483e8fc9a9a074d5e046_SeqId_47_ 2023-04-09 15:54:44,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-04-09 15:54:44,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:44,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:44,587 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: f956cf1b99eed391208338072bc13788 to self. 2023-04-09 15:54:44,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f956cf1b99eed391208338072bc13788 2023-04-09 15:54:44,588 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=f956cf1b99eed391208338072bc13788, regionState=CLOSED 2023-04-09 15:54:44,589 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1681055684588"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055684588"}]},"ts":"1681055684588"} 2023-04-09 15:54:44,591 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-04-09 15:54:44,591 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure f956cf1b99eed391208338072bc13788, server=jenkins-hbase4.apache.org,44869,1681055618167 in 367 msec 2023-04-09 15:54:44,591 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f956cf1b99eed391208338072bc13788, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=true 2023-04-09 15:54:44,742 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=f956cf1b99eed391208338072bc13788, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:44,742 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1681055684741"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055684741"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055684741"}]},"ts":"1681055684741"} 2023-04-09 15:54:44,743 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure f956cf1b99eed391208338072bc13788, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:44,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:44,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f956cf1b99eed391208338072bc13788, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.', STARTKEY => '', ENDKEY => ''} 2023-04-09 15:54:44,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily f956cf1b99eed391208338072bc13788 2023-04-09 15:54:44,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:44,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f956cf1b99eed391208338072bc13788 2023-04-09 15:54:44,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f956cf1b99eed391208338072bc13788 2023-04-09 15:54:44,899 INFO [StoreOpener-f956cf1b99eed391208338072bc13788-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f956cf1b99eed391208338072bc13788 2023-04-09 15:54:44,900 DEBUG [StoreOpener-f956cf1b99eed391208338072bc13788-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1 2023-04-09 15:54:44,900 DEBUG [StoreOpener-f956cf1b99eed391208338072bc13788-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1 2023-04-09 15:54:44,901 INFO [StoreOpener-f956cf1b99eed391208338072bc13788-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f956cf1b99eed391208338072bc13788 columnFamilyName family1 2023-04-09 15:54:44,905 DEBUG [StoreOpener-f956cf1b99eed391208338072bc13788-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/956d4e1a58524496b359b61d1c4ea5ad 2023-04-09 15:54:44,905 INFO [StoreOpener-f956cf1b99eed391208338072bc13788-1] regionserver.HStore(310): Store=f956cf1b99eed391208338072bc13788/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:44,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788 2023-04-09 15:54:44,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788 2023-04-09 15:54:44,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f956cf1b99eed391208338072bc13788 2023-04-09 15:54:44,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f956cf1b99eed391208338072bc13788; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64451493, jitterRate=-0.03959791362285614}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-09 15:54:44,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:44,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788., pid=63, masterSystemTime=1681055684895 2023-04-09 15:54:44,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:44,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:44,911 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=f956cf1b99eed391208338072bc13788, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:44,912 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1681055684911"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055684911"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055684911"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055684911"}]},"ts":"1681055684911"} 2023-04-09 15:54:44,914 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-04-09 15:54:44,914 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure f956cf1b99eed391208338072bc13788, server=jenkins-hbase4.apache.org,44869,1681055618167 in 170 msec 2023-04-09 15:54:44,915 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-04-09 15:54:44,915 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f956cf1b99eed391208338072bc13788, REOPEN/MOVE in 693 msec 2023-04-09 15:54:44,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-04-09 15:54:44,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 698 msec 2023-04-09 15:54:44,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1130 sec 2023-04-09 15:54:44,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-04-09 15:54:44,921 INFO [Listener at localhost/39283] compactions.TestMobCompactor(278): alter status finished 2023-04-09 15:54:44,922 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33617] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:44,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-04-09 15:54:44,923 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-04-09 15:54:44,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:44,924 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1681056284924 2023-04-09 15:54:44,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-09 15:54:44,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-04-09 15:54:44,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-09 15:54:44,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] zookeeper.ReadOnlyZKClient(139): Connect 0x446f3a46 to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:54:44,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11651fca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:54:44,930 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:44,930 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:44,930 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:44,930 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:44,930 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:45,752 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128fd08d7263c284be8b80a42f9ef90ecf4 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128fd08d7263c284be8b80a42f9ef90ecf4 2023-04-09 15:54:45,753 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-09 15:54:45,765 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:54:45,766 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:54:45,772 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-09 15:54:45,773 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-09 15:54:45,781 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c05093c4e91446a9926507a64f926981 first=Optional[r05] last=Optional[r8] 2023-04-09 15:54:45,781 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=51 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c05093c4e91446a9926507a64f926981}] 2023-04-09 15:54:45,785 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c05093c4e91446a9926507a64f926981 for inclusion in f956cf1b99eed391208338072bc13788/family1 2023-04-09 15:54:45,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-04-09 15:54:45,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:54:45,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:45,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c05093c4e91446a9926507a64f926981 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__64pitbfnigjet0bepv4g3quouavd60f8c2v13qeg2j21vkf62ifjkltnhnqkgm3k/family1/c05093c4e91446a9926507a64f926981 2023-04-09 15:54:45,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__64pitbfnigjet0bepv4g3quouavd60f8c2v13qeg2j21vkf62ifjkltnhnqkgm3k/family1/c05093c4e91446a9926507a64f926981 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/93cee97053ba4b76a17ee8dc58e0a96c_SeqId_53_ 2023-04-09 15:54:45,791 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__64pitbfnigjet0bepv4g3quouavd60f8c2v13qeg2j21vkf62ifjkltnhnqkgm3k/family1/c05093c4e91446a9926507a64f926981 into f956cf1b99eed391208338072bc13788/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/93cee97053ba4b76a17ee8dc58e0a96c_SeqId_53_ - updating store file list. 2023-04-09 15:54:45,794 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/93cee97053ba4b76a17ee8dc58e0a96c_SeqId_53_ into f956cf1b99eed391208338072bc13788/family1 2023-04-09 15:54:45,794 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__64pitbfnigjet0bepv4g3quouavd60f8c2v13qeg2j21vkf62ifjkltnhnqkgm3k/family1/c05093c4e91446a9926507a64f926981 into f956cf1b99eed391208338072bc13788/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/93cee97053ba4b76a17ee8dc58e0a96c_SeqId_53_) 2023-04-09 15:54:45,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__64pitbfnigjet0bepv4g3quouavd60f8c2v13qeg2j21vkf62ifjkltnhnqkgm3k/family1/c05093c4e91446a9926507a64f926981 2023-04-09 15:54:45,796 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-09 15:54:45,797 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:45,798 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120ae72c2c5c4694755b3526c8944dd6e42 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120ae72c2c5c4694755b3526c8944dd6e42 2023-04-09 15:54:45,799 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112868de5650f07f4e58b351e0945628dcfb to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112868de5650f07f4e58b351e0945628dcfb 2023-04-09 15:54:45,799 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-04-09 15:54:45,799 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-04-09 15:54:45,799 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:45,800 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:45,800 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:45,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-09 15:54:45,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:45,801 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-04-09 15:54:45,802 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 879 msec 2023-04-09 15:54:45,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-04-09 15:54:45,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:46,257 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-04-09 15:54:46,258 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-04-09 15:54:46,258 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-04-09 15:54:46,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-04-09 15:54:46,262 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f956cf1b99eed391208338072bc13788, REOPEN/MOVE}] 2023-04-09 15:54:46,263 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f956cf1b99eed391208338072bc13788, REOPEN/MOVE 2023-04-09 15:54:46,263 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f956cf1b99eed391208338072bc13788, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:46,263 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1681055686263"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055686263"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055686263"}]},"ts":"1681055686263"} 2023-04-09 15:54:46,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure f956cf1b99eed391208338072bc13788, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:46,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f956cf1b99eed391208338072bc13788 2023-04-09 15:54:46,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f956cf1b99eed391208338072bc13788, disabling compactions & flushes 2023-04-09 15:54:46,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:46,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:46,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. after waiting 0 ms 2023-04-09 15:54:46,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:46,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-04-09 15:54:46,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:46,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:46,420 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: f956cf1b99eed391208338072bc13788 to self. 2023-04-09 15:54:46,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f956cf1b99eed391208338072bc13788 2023-04-09 15:54:46,422 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f956cf1b99eed391208338072bc13788, regionState=CLOSED 2023-04-09 15:54:46,422 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1681055686422"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055686422"}]},"ts":"1681055686422"} 2023-04-09 15:54:46,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-04-09 15:54:46,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure f956cf1b99eed391208338072bc13788, server=jenkins-hbase4.apache.org,44869,1681055618167 in 159 msec 2023-04-09 15:54:46,424 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f956cf1b99eed391208338072bc13788, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=true 2023-04-09 15:54:46,575 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f956cf1b99eed391208338072bc13788, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:46,575 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1681055686575"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055686575"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055686575"}]},"ts":"1681055686575"} 2023-04-09 15:54:46,577 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure f956cf1b99eed391208338072bc13788, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:46,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:46,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f956cf1b99eed391208338072bc13788, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.', STARTKEY => '', ENDKEY => ''} 2023-04-09 15:54:46,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily f956cf1b99eed391208338072bc13788 2023-04-09 15:54:46,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:46,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f956cf1b99eed391208338072bc13788 2023-04-09 15:54:46,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f956cf1b99eed391208338072bc13788 2023-04-09 15:54:46,734 INFO [StoreOpener-f956cf1b99eed391208338072bc13788-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f956cf1b99eed391208338072bc13788 2023-04-09 15:54:46,734 DEBUG [StoreOpener-f956cf1b99eed391208338072bc13788-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1 2023-04-09 15:54:46,734 DEBUG [StoreOpener-f956cf1b99eed391208338072bc13788-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1 2023-04-09 15:54:46,735 INFO [StoreOpener-f956cf1b99eed391208338072bc13788-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f956cf1b99eed391208338072bc13788 columnFamilyName family1 2023-04-09 15:54:46,739 DEBUG [StoreOpener-f956cf1b99eed391208338072bc13788-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/93cee97053ba4b76a17ee8dc58e0a96c_SeqId_53_ 2023-04-09 15:54:46,742 DEBUG [StoreOpener-f956cf1b99eed391208338072bc13788-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/family1/956d4e1a58524496b359b61d1c4ea5ad 2023-04-09 15:54:46,742 INFO [StoreOpener-f956cf1b99eed391208338072bc13788-1] regionserver.HStore(310): Store=f956cf1b99eed391208338072bc13788/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:46,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788 2023-04-09 15:54:46,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788 2023-04-09 15:54:46,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f956cf1b99eed391208338072bc13788 2023-04-09 15:54:46,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f956cf1b99eed391208338072bc13788; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75116493, jitterRate=0.11932297050952911}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-09 15:54:46,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:54:46,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788., pid=69, masterSystemTime=1681055686728 2023-04-09 15:54:46,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:46,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:54:46,749 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f956cf1b99eed391208338072bc13788, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:46,749 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1681055686749"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055686749"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055686749"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055686749"}]},"ts":"1681055686749"} 2023-04-09 15:54:46,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-04-09 15:54:46,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure f956cf1b99eed391208338072bc13788, server=jenkins-hbase4.apache.org,44869,1681055618167 in 173 msec 2023-04-09 15:54:46,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-04-09 15:54:46,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f956cf1b99eed391208338072bc13788, REOPEN/MOVE in 489 msec 2023-04-09 15:54:46,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-04-09 15:54:46,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 493 msec 2023-04-09 15:54:46,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 906 msec 2023-04-09 15:54:46,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-04-09 15:54:46,756 INFO [Listener at localhost/39283] compactions.TestMobCompactor(278): alter status finished 2023-04-09 15:54:46,757 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33617] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-04-09 15:54:46,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-04-09 15:54:46,759 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-04-09 15:54:46,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:46,759 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1681056286759 2023-04-09 15:54:46,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-09 15:54:46,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-04-09 15:54:46,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-09 15:54:46,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] zookeeper.ReadOnlyZKClient(139): Connect 0x238f6a2f to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:54:46,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29bac5cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:54:46,765 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:46,765 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:46,765 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:46,765 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:46,765 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:46,765 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:46,765 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:46,765 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-04-09 15:54:46,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-04-09 15:54:46,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:46,766 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-04-09 15:54:46,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 8 msec 2023-04-09 15:54:46,812 INFO [Listener at localhost/39283] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=254 (was 260), OpenFileDescriptor=642 (was 629) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=405 (was 426), ProcessCount=169 (was 169), AvailableMemoryMB=1609 (was 1618) 2023-04-09 15:54:46,822 INFO [Listener at localhost/39283] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=254, OpenFileDescriptor=642, MaxFileDescriptor=60000, SystemLoadAverage=405, ProcessCount=169, AvailableMemoryMB=1608 2023-04-09 15:54:46,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-04-09 15:54:46,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-04-09 15:54:46,828 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-04-09 15:54:46,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-04-09 15:54:46,828 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-09 15:54:46,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-04-09 15:54:46,830 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04 2023-04-09 15:54:46,830 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04 empty. 2023-04-09 15:54:46,830 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04 2023-04-09 15:54:46,831 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-04-09 15:54:46,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-04-09 15:54:47,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-04-09 15:54:47,238 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-04-09 15:54:47,239 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6aaa283e1dd8457277c23adfef351f04, NAME => 'testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:54:47,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-04-09 15:54:47,645 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:47,645 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 6aaa283e1dd8457277c23adfef351f04, disabling compactions & flushes 2023-04-09 15:54:47,645 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04. 2023-04-09 15:54:47,645 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04. 2023-04-09 15:54:47,645 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04. after waiting 0 ms 2023-04-09 15:54:47,645 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04. 2023-04-09 15:54:47,645 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04. 2023-04-09 15:54:47,645 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 6aaa283e1dd8457277c23adfef351f04: 2023-04-09 15:54:47,647 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-04-09 15:54:47,648 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1681055687648"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055687648"}]},"ts":"1681055687648"} 2023-04-09 15:54:47,649 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-04-09 15:54:47,649 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-09 15:54:47,649 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055687649"}]},"ts":"1681055687649"} 2023-04-09 15:54:47,650 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-04-09 15:54:47,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=6aaa283e1dd8457277c23adfef351f04, ASSIGN}] 2023-04-09 15:54:47,655 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=6aaa283e1dd8457277c23adfef351f04, ASSIGN 2023-04-09 15:54:47,655 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=6aaa283e1dd8457277c23adfef351f04, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:54:47,806 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=6aaa283e1dd8457277c23adfef351f04, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:47,806 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1681055687806"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055687806"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055687806"}]},"ts":"1681055687806"} 2023-04-09 15:54:47,808 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 6aaa283e1dd8457277c23adfef351f04, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:47,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-04-09 15:54:47,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04. 2023-04-09 15:54:47,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6aaa283e1dd8457277c23adfef351f04, NAME => 'testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04.', STARTKEY => '', ENDKEY => ''} 2023-04-09 15:54:47,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-04-09 15:54:47,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-04-09 15:54:47,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 6aaa283e1dd8457277c23adfef351f04 2023-04-09 15:54:47,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:47,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6aaa283e1dd8457277c23adfef351f04 2023-04-09 15:54:47,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6aaa283e1dd8457277c23adfef351f04 2023-04-09 15:54:47,965 INFO [StoreOpener-6aaa283e1dd8457277c23adfef351f04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6aaa283e1dd8457277c23adfef351f04 2023-04-09 15:54:47,966 DEBUG [StoreOpener-6aaa283e1dd8457277c23adfef351f04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1 2023-04-09 15:54:47,966 DEBUG [StoreOpener-6aaa283e1dd8457277c23adfef351f04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1 2023-04-09 15:54:47,967 INFO [StoreOpener-6aaa283e1dd8457277c23adfef351f04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6aaa283e1dd8457277c23adfef351f04 columnFamilyName f1 2023-04-09 15:54:47,968 INFO [StoreOpener-6aaa283e1dd8457277c23adfef351f04-1] regionserver.HStore(310): Store=6aaa283e1dd8457277c23adfef351f04/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:47,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04 2023-04-09 15:54:47,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04 2023-04-09 15:54:47,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6aaa283e1dd8457277c23adfef351f04 2023-04-09 15:54:47,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:54:47,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6aaa283e1dd8457277c23adfef351f04; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62633159, jitterRate=-0.06669320166110992}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-09 15:54:47,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6aaa283e1dd8457277c23adfef351f04: 2023-04-09 15:54:47,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04., pid=73, masterSystemTime=1681055687959 2023-04-09 15:54:47,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04. 2023-04-09 15:54:47,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04. 2023-04-09 15:54:47,976 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=6aaa283e1dd8457277c23adfef351f04, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:47,976 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1681055687976"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055687976"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055687976"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055687976"}]},"ts":"1681055687976"} 2023-04-09 15:54:47,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-04-09 15:54:47,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 6aaa283e1dd8457277c23adfef351f04, server=jenkins-hbase4.apache.org,44869,1681055618167 in 170 msec 2023-04-09 15:54:47,980 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-04-09 15:54:47,980 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=6aaa283e1dd8457277c23adfef351f04, ASSIGN in 326 msec 2023-04-09 15:54:47,980 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-09 15:54:47,981 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055687981"}]},"ts":"1681055687981"} 2023-04-09 15:54:47,982 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-04-09 15:54:47,984 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-04-09 15:54:47,985 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1580 sec 2023-04-09 15:54:48,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-04-09 15:54:48,934 INFO [Listener at localhost/39283] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-04-09 15:54:48,934 DEBUG [Listener at localhost/39283] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-04-09 15:54:48,936 INFO [Listener at localhost/39283] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-04-09 15:54:48,939 INFO [Listener at localhost/39283] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-04-09 15:54:48,939 INFO [Listener at localhost/39283] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-04-09 15:54:48,940 INFO [Listener at localhost/39283] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-04-09 15:54:48,943 INFO [Listener at localhost/39283] regionserver.HRegion(2745): Flushing 6aaa283e1dd8457277c23adfef351f04 1/1 column families, dataSize=37 B heapSize=368 B 2023-04-09 15:54:49,355 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304092407d18ba32e4efa8a41d09138cb4e21 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202304092407d18ba32e4efa8a41d09138cb4e21 2023-04-09 15:54:49,760 INFO [Listener at localhost/39283] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/.tmp/f1/5216b0ed4590466fb7a76911372b4197 2023-04-09 15:54:49,765 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/.tmp/f1/5216b0ed4590466fb7a76911372b4197 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197 2023-04-09 15:54:49,769 INFO [Listener at localhost/39283] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197, entries=1, sequenceid=5, filesize=4.9 K 2023-04-09 15:54:49,770 INFO [Listener at localhost/39283] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 6aaa283e1dd8457277c23adfef351f04 in 827ms, sequenceid=5, compaction requested=false 2023-04-09 15:54:49,771 DEBUG [Listener at localhost/39283] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-04-09 15:54:49,771 DEBUG [Listener at localhost/39283] regionserver.HRegion(2446): Flush status journal for 6aaa283e1dd8457277c23adfef351f04: 2023-04-09 15:54:49,773 INFO [Listener at localhost/39283] regionserver.HRegion(2745): Flushing 6aaa283e1dd8457277c23adfef351f04 1/1 column families, dataSize=37 B heapSize=368 B 2023-04-09 15:54:50,118 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-09 15:54:50,169 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-09 15:54:50,169 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e596546 to 127.0.0.1:64813 2023-04-09 15:54:50,169 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:54:50,169 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x238f6a2f to 127.0.0.1:64813 2023-04-09 15:54:50,169 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:54:50,169 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-09 15:54:50,169 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x446f3a46 to 127.0.0.1:64813 2023-04-09 15:54:50,169 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:54:50,169 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-09 15:54:50,169 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03961fe9 to 127.0.0.1:64813 2023-04-09 15:54:50,170 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:54:50,170 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52478fa8 to 127.0.0.1:64813 2023-04-09 15:54:50,170 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:54:50,170 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-09 15:54:50,170 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c81bb25 to 127.0.0.1:64813 2023-04-09 15:54:50,170 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:54:50,184 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023040971500053e63f4345b285e6c1628e3786 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023040971500053e63f4345b285e6c1628e3786 2023-04-09 15:54:50,589 INFO [Listener at localhost/39283] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/.tmp/f1/56b64596491e4e75bf221967993ff7c9 2023-04-09 15:54:50,593 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/.tmp/f1/56b64596491e4e75bf221967993ff7c9 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9 2023-04-09 15:54:50,596 INFO [Listener at localhost/39283] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9, entries=1, sequenceid=9, filesize=4.9 K 2023-04-09 15:54:50,597 INFO [Listener at localhost/39283] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 6aaa283e1dd8457277c23adfef351f04 in 824ms, sequenceid=9, compaction requested=false 2023-04-09 15:54:50,597 DEBUG [Listener at localhost/39283] regionserver.HRegion(2446): Flush status journal for 6aaa283e1dd8457277c23adfef351f04: 2023-04-09 15:54:50,599 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33617] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-04-09 15:54:50,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-04-09 15:54:50,600 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-04-09 15:54:50,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:50,601 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1681056290601 2023-04-09 15:54:50,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-04-09 15:54:50,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-04-09 15:54:50,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-04-09 15:54:50,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] zookeeper.ReadOnlyZKClient(139): Connect 0x5e3d1fe8 to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:54:50,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21d62d5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:54:50,607 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230409 for table='testGetAfterCompaction' and column='f1' 2023-04-09 15:54:50,650 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:50,650 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:50,701 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:50,701 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:50,752 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:50,752 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:50,802 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:50,803 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:50,853 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:50,853 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:50,904 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:50,904 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:50,955 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:50,955 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,006 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,006 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,057 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,057 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,108 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,108 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,158 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,159 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,209 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,209 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,260 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,260 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,311 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,311 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,362 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,362 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,413 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,413 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,429 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304093f328b7f20d94efab502c4f61fc943cf to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202304093f328b7f20d94efab502c4f61fc943cf 2023-04-09 15:54:51,430 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230409 table='testGetAfterCompaction' column='f1' 2023-04-09 15:54:51,443 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:54:51,444 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:54:51,450 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-09 15:54:51,451 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-09 15:54:51,459 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230409/f1/1be981b8641e4ae1b0e56ef0c14dc660 first=Optional[r1] last=Optional[r2] 2023-04-09 15:54:51,460 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{f1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230409/f1/1be981b8641e4ae1b0e56ef0c14dc660}] 2023-04-09 15:54:51,464 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,464 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230409/f1/1be981b8641e4ae1b0e56ef0c14dc660 for inclusion in 6aaa283e1dd8457277c23adfef351f04/f1 2023-04-09 15:54:51,464 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-04-09 15:54:51,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:54:51,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for 6aaa283e1dd8457277c23adfef351f04: 2023-04-09 15:54:51,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230409/f1/1be981b8641e4ae1b0e56ef0c14dc660 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testGetAfterCompaction__ll277a9607id1dsnfv9m6ptgchan72a2lnme3fteu3ogkaafilvt2hudh3vhcqgv/f1/1be981b8641e4ae1b0e56ef0c14dc660 2023-04-09 15:54:51,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testGetAfterCompaction__ll277a9607id1dsnfv9m6ptgchan72a2lnme3fteu3ogkaafilvt2hudh3vhcqgv/f1/1be981b8641e4ae1b0e56ef0c14dc660 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_ 2023-04-09 15:54:51,470 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testGetAfterCompaction__ll277a9607id1dsnfv9m6ptgchan72a2lnme3fteu3ogkaafilvt2hudh3vhcqgv/f1/1be981b8641e4ae1b0e56ef0c14dc660 into 6aaa283e1dd8457277c23adfef351f04/f1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_ - updating store file list. 2023-04-09 15:54:51,473 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_ into 6aaa283e1dd8457277c23adfef351f04/f1 2023-04-09 15:54:51,473 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testGetAfterCompaction__ll277a9607id1dsnfv9m6ptgchan72a2lnme3fteu3ogkaafilvt2hudh3vhcqgv/f1/1be981b8641e4ae1b0e56ef0c14dc660 into 6aaa283e1dd8457277c23adfef351f04/f1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_) 2023-04-09 15:54:51,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testGetAfterCompaction__ll277a9607id1dsnfv9m6ptgchan72a2lnme3fteu3ogkaafilvt2hudh3vhcqgv/f1/1be981b8641e4ae1b0e56ef0c14dc660 2023-04-09 15:54:51,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(1912): 6aaa283e1dd8457277c23adfef351f04/f1 is initiating minor compaction 2023-04-09 15:54:51,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@623f1d48; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:51,474 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6aaa283e1dd8457277c23adfef351f04/f1 in testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04. 2023-04-09 15:54:51,474 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/.tmp, totalSize=10.0 K 2023-04-09 15:54:51,474 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 56b64596491e4e75bf221967993ff7c9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-04-09 15:54:51,474 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting e1622a900d46400291efe307137998c9_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-04-09 15:54:51,476 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230409 table='testGetAfterCompaction' column='f1' 2023-04-09 15:54:51,477 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:51,478 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202304092407d18ba32e4efa8a41d09138cb4e21 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202304092407d18ba32e4efa8a41d09138cb4e21 2023-04-09 15:54:51,479 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023040971500053e63f4345b285e6c1628e3786 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023040971500053e63f4345b285e6c1628e3786 2023-04-09 15:54:51,479 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-04-09 15:54:51,479 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230409' 2023-04-09 15:54:51,480 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230409 for table='testGetAfterCompaction' and column='f1' 2023-04-09 15:54:51,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-04-09 15:54:51,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:54:51,481 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-04-09 15:54:51,482 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6aaa283e1dd8457277c23adfef351f04#f1#compaction#76 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-04-09 15:54:51,482 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 882 msec 2023-04-09 15:54:51,514 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,515 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,515 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1681055691425; access_time=1681055690617; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-09 15:54:51,518 DEBUG [Listener at localhost/39283] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-04-09 15:54:51,521 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-04-09 15:54:51,522 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44869] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04. 2023-04-09 15:54:51,522 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44869] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-04-09 15:54:51,522 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44869] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-04-09 15:54:51,522 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44869] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-04-09 15:54:51,522 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44869] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04. because compaction request was cancelled 2023-04-09 15:54:51,574 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,574 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,574 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1681055691425; access_time=1681055690617; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-09 15:54:51,624 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,625 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,625 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1681055691425; access_time=1681055690617; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-09 15:54:51,675 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,676 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,676 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1681055691425; access_time=1681055690617; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-09 15:54:51,726 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,726 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,727 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1681055691425; access_time=1681055690617; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-09 15:54:51,777 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,778 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,778 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1681055691425; access_time=1681055690617; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-09 15:54:51,828 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,828 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,828 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1681055691425; access_time=1681055690617; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-09 15:54:51,879 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,879 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,879 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1681055691425; access_time=1681055690617; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-09 15:54:51,930 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,930 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,930 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1681055691425; access_time=1681055690617; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-09 15:54:51,981 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,981 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:51,981 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1681055691425; access_time=1681055690617; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-09 15:54:52,032 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:52,032 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:52,032 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1681055691425; access_time=1681055690617; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-09 15:54:52,083 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:52,083 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:52,083 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1681055691425; access_time=1681055690617; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-09 15:54:52,134 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:52,134 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:52,134 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1681055691425; access_time=1681055690617; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-09 15:54:52,184 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:52,185 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:52,185 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1681055691425; access_time=1681055690617; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-09 15:54:52,236 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:52,236 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:52,236 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1681055691425; access_time=1681055690617; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-09 15:54:52,287 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:52,287 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:52,287 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1681055691425; access_time=1681055690617; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-09 15:54:52,298 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/.tmp/f1/0144024677494b91a8d112acce603e3f as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/0144024677494b91a8d112acce603e3f 2023-04-09 15:54:52,305 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 6aaa283e1dd8457277c23adfef351f04/f1 of 6aaa283e1dd8457277c23adfef351f04 into 0144024677494b91a8d112acce603e3f(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:54:52,305 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6aaa283e1dd8457277c23adfef351f04: 2023-04-09 15:54:52,305 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1681055691474; duration=0sec 2023-04-09 15:54:52,305 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:54:52,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_] to archive 2023-04-09 15:54:52,339 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/0144024677494b91a8d112acce603e3f; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1681055692290; access_time=1681055691479; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:52,339 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:52,339 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055690589; access_time=1681055689775; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:52,339 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1681055691425; access_time=1681055690617; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-04-09 15:54:52,341 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:54:52,343 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/56b64596491e4e75bf221967993ff7c9 2023-04-09 15:54:52,345 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/e1622a900d46400291efe307137998c9_SeqId_12_ 2023-04-09 15:54:52,390 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/0144024677494b91a8d112acce603e3f; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1681055692290; access_time=1681055691479; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:52,390 INFO [Listener at localhost/39283] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1681055689760; access_time=1681055688946; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-04-09 15:54:52,515 INFO [Listener at localhost/39283] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-04-09 15:54:52,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-04-09 15:54:52,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-04-09 15:54:52,532 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055692532"}]},"ts":"1681055692532"} 2023-04-09 15:54:52,534 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-04-09 15:54:52,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-04-09 15:54:52,539 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-04-09 15:54:52,541 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=6aaa283e1dd8457277c23adfef351f04, UNASSIGN}] 2023-04-09 15:54:52,542 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=6aaa283e1dd8457277c23adfef351f04, UNASSIGN 2023-04-09 15:54:52,543 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=6aaa283e1dd8457277c23adfef351f04, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:52,543 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1681055692543"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055692543"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055692543"}]},"ts":"1681055692543"} 2023-04-09 15:54:52,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 6aaa283e1dd8457277c23adfef351f04, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:52,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-04-09 15:54:52,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6aaa283e1dd8457277c23adfef351f04 2023-04-09 15:54:52,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6aaa283e1dd8457277c23adfef351f04, disabling compactions & flushes 2023-04-09 15:54:52,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04. 2023-04-09 15:54:52,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04. 2023-04-09 15:54:52,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04. after waiting 0 ms 2023-04-09 15:54:52,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04. 2023-04-09 15:54:52,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-04-09 15:54:52,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-04-09 15:54:52,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04. 2023-04-09 15:54:52,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6aaa283e1dd8457277c23adfef351f04: 2023-04-09 15:54:52,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6aaa283e1dd8457277c23adfef351f04 2023-04-09 15:54:52,704 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=6aaa283e1dd8457277c23adfef351f04, regionState=CLOSED 2023-04-09 15:54:52,704 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1681055692704"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055692704"}]},"ts":"1681055692704"} 2023-04-09 15:54:52,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-04-09 15:54:52,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 6aaa283e1dd8457277c23adfef351f04, server=jenkins-hbase4.apache.org,44869,1681055618167 in 161 msec 2023-04-09 15:54:52,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-04-09 15:54:52,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=6aaa283e1dd8457277c23adfef351f04, UNASSIGN in 166 msec 2023-04-09 15:54:52,709 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055692709"}]},"ts":"1681055692709"} 2023-04-09 15:54:52,710 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-04-09 15:54:52,712 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-04-09 15:54:52,714 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 191 msec 2023-04-09 15:54:52,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-04-09 15:54:52,839 INFO [Listener at localhost/39283] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-04-09 15:54:52,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-04-09 15:54:52,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-04-09 15:54:52,854 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-04-09 15:54:52,856 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-04-09 15:54:52,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-04-09 15:54:52,860 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04 2023-04-09 15:54:52,862 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1, FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/recovered.edits] 2023-04-09 15:54:52,867 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/0144024677494b91a8d112acce603e3f to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/0144024677494b91a8d112acce603e3f 2023-04-09 15:54:52,869 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/f1/5216b0ed4590466fb7a76911372b4197 2023-04-09 15:54:52,873 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/recovered.edits/15.seqid to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04/recovered.edits/15.seqid 2023-04-09 15:54:52,873 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testGetAfterCompaction/6aaa283e1dd8457277c23adfef351f04 2023-04-09 15:54:52,873 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-04-09 15:54:52,874 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-04-09 15:54:52,875 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-04-09 15:54:52,879 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202304093f328b7f20d94efab502c4f61fc943cf to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202304093f328b7f20d94efab502c4f61fc943cf 2023-04-09 15:54:52,880 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-04-09 15:54:52,883 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-04-09 15:54:52,912 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-04-09 15:54:52,915 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-04-09 15:54:52,916 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-04-09 15:54:52,916 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-04-09 15:54:52,916 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1681055692916"}]},"ts":"9223372036854775807"} 2023-04-09 15:54:52,919 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-04-09 15:54:52,919 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6aaa283e1dd8457277c23adfef351f04, NAME => 'testGetAfterCompaction,,1681055686826.6aaa283e1dd8457277c23adfef351f04.', STARTKEY => '', ENDKEY => ''}] 2023-04-09 15:54:52,919 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-04-09 15:54:52,920 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1681055692919"}]},"ts":"9223372036854775807"} 2023-04-09 15:54:52,921 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-04-09 15:54:52,923 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-04-09 15:54:52,924 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 77 msec 2023-04-09 15:54:52,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-04-09 15:54:52,959 INFO [Listener at localhost/39283] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-04-09 15:54:52,973 INFO [Listener at localhost/39283] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=237 (was 254), OpenFileDescriptor=598 (was 642), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=383 (was 405), ProcessCount=169 (was 169), AvailableMemoryMB=1593 (was 1608) 2023-04-09 15:54:52,986 INFO [Listener at localhost/39283] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=237, OpenFileDescriptor=598, MaxFileDescriptor=60000, SystemLoadAverage=383, ProcessCount=169, AvailableMemoryMB=1592 2023-04-09 15:54:52,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-04-09 15:54:52,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-04-09 15:54:52,990 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-04-09 15:54:52,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-04-09 15:54:52,991 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-09 15:54:52,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-04-09 15:54:52,994 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:54:52,994 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895 2023-04-09 15:54:52,994 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185 2023-04-09 15:54:52,995 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185 empty. 2023-04-09 15:54:52,995 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895 empty. 2023-04-09 15:54:52,995 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185 2023-04-09 15:54:52,995 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd empty. 2023-04-09 15:54:52,995 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895 2023-04-09 15:54:52,995 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:54:52,996 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-04-09 15:54:53,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-04-09 15:54:53,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-04-09 15:54:53,406 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-04-09 15:54:53,409 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0ae7083b5e65fccc3e4562ffb1cd8cdd, NAME => 'testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:54:53,409 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 5edb26c74099296449ac252e8aa24185, NAME => 'testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:54:53,410 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2720147230b846f05cd943c11531e895, NAME => 'testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:54:53,440 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:53,440 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 5edb26c74099296449ac252e8aa24185, disabling compactions & flushes 2023-04-09 15:54:53,440 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:54:53,440 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:54:53,440 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. after waiting 0 ms 2023-04-09 15:54:53,440 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:54:53,440 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:54:53,441 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 5edb26c74099296449ac252e8aa24185: 2023-04-09 15:54:53,442 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:53,442 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 2720147230b846f05cd943c11531e895, disabling compactions & flushes 2023-04-09 15:54:53,442 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:54:53,442 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:54:53,442 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. after waiting 0 ms 2023-04-09 15:54:53,442 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:54:53,442 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:54:53,442 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 2720147230b846f05cd943c11531e895: 2023-04-09 15:54:53,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-04-09 15:54:53,827 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:53,827 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 0ae7083b5e65fccc3e4562ffb1cd8cdd, disabling compactions & flushes 2023-04-09 15:54:53,827 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:54:53,827 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:54:53,827 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. after waiting 0 ms 2023-04-09 15:54:53,827 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:54:53,827 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:54:53,827 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 0ae7083b5e65fccc3e4562ffb1cd8cdd: 2023-04-09 15:54:53,830 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-04-09 15:54:53,831 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1681055693831"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055693831"}]},"ts":"1681055693831"} 2023-04-09 15:54:53,831 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1681055693831"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055693831"}]},"ts":"1681055693831"} 2023-04-09 15:54:53,831 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1681055693831"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055693831"}]},"ts":"1681055693831"} 2023-04-09 15:54:53,842 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-04-09 15:54:53,843 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-09 15:54:53,843 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055693843"}]},"ts":"1681055693843"} 2023-04-09 15:54:53,845 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-04-09 15:54:53,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ae7083b5e65fccc3e4562ffb1cd8cdd, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2720147230b846f05cd943c11531e895, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5edb26c74099296449ac252e8aa24185, ASSIGN}] 2023-04-09 15:54:53,852 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5edb26c74099296449ac252e8aa24185, ASSIGN 2023-04-09 15:54:53,853 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2720147230b846f05cd943c11531e895, ASSIGN 2023-04-09 15:54:53,853 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ae7083b5e65fccc3e4562ffb1cd8cdd, ASSIGN 2023-04-09 15:54:53,853 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5edb26c74099296449ac252e8aa24185, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:54:53,853 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ae7083b5e65fccc3e4562ffb1cd8cdd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:54:53,854 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2720147230b846f05cd943c11531e895, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:54:54,006 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=2720147230b846f05cd943c11531e895, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:54,006 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=5edb26c74099296449ac252e8aa24185, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:54,006 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=0ae7083b5e65fccc3e4562ffb1cd8cdd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:54,006 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1681055694006"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055694006"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055694006"}]},"ts":"1681055694006"} 2023-04-09 15:54:54,006 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1681055694006"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055694006"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055694006"}]},"ts":"1681055694006"} 2023-04-09 15:54:54,006 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1681055694006"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055694006"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055694006"}]},"ts":"1681055694006"} 2023-04-09 15:54:54,008 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure 2720147230b846f05cd943c11531e895, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:54,009 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=80, state=RUNNABLE; OpenRegionProcedure 0ae7083b5e65fccc3e4562ffb1cd8cdd, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:54,011 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure 5edb26c74099296449ac252e8aa24185, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:54:54,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-04-09 15:54:54,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:54:54,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5edb26c74099296449ac252e8aa24185, NAME => 'testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185.', STARTKEY => '2', ENDKEY => ''} 2023-04-09 15:54:54,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 5edb26c74099296449ac252e8aa24185 2023-04-09 15:54:54,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:54,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5edb26c74099296449ac252e8aa24185 2023-04-09 15:54:54,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5edb26c74099296449ac252e8aa24185 2023-04-09 15:54:54,166 INFO [StoreOpener-5edb26c74099296449ac252e8aa24185-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5edb26c74099296449ac252e8aa24185 2023-04-09 15:54:54,168 DEBUG [StoreOpener-5edb26c74099296449ac252e8aa24185-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1 2023-04-09 15:54:54,168 DEBUG [StoreOpener-5edb26c74099296449ac252e8aa24185-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1 2023-04-09 15:54:54,168 INFO [StoreOpener-5edb26c74099296449ac252e8aa24185-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5edb26c74099296449ac252e8aa24185 columnFamilyName family1 2023-04-09 15:54:54,170 INFO [StoreOpener-5edb26c74099296449ac252e8aa24185-1] regionserver.HStore(310): Store=5edb26c74099296449ac252e8aa24185/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:54,170 INFO [StoreOpener-5edb26c74099296449ac252e8aa24185-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5edb26c74099296449ac252e8aa24185 2023-04-09 15:54:54,172 DEBUG [StoreOpener-5edb26c74099296449ac252e8aa24185-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2 2023-04-09 15:54:54,172 DEBUG [StoreOpener-5edb26c74099296449ac252e8aa24185-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2 2023-04-09 15:54:54,172 INFO [StoreOpener-5edb26c74099296449ac252e8aa24185-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5edb26c74099296449ac252e8aa24185 columnFamilyName family2 2023-04-09 15:54:54,173 INFO [StoreOpener-5edb26c74099296449ac252e8aa24185-1] regionserver.HStore(310): Store=5edb26c74099296449ac252e8aa24185/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:54,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185 2023-04-09 15:54:54,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185 2023-04-09 15:54:54,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-09 15:54:54,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5edb26c74099296449ac252e8aa24185 2023-04-09 15:54:54,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:54:54,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5edb26c74099296449ac252e8aa24185; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74331623, jitterRate=0.1076274961233139}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-09 15:54:54,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5edb26c74099296449ac252e8aa24185: 2023-04-09 15:54:54,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185., pid=85, masterSystemTime=1681055694162 2023-04-09 15:54:54,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:54:54,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:54:54,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:54:54,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0ae7083b5e65fccc3e4562ffb1cd8cdd, NAME => 'testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd.', STARTKEY => '', ENDKEY => '1'} 2023-04-09 15:54:54,183 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=5edb26c74099296449ac252e8aa24185, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:54,184 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1681055694183"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055694183"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055694183"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055694183"}]},"ts":"1681055694183"} 2023-04-09 15:54:54,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:54:54,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:54,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:54:54,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:54:54,185 INFO [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:54:54,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=82 2023-04-09 15:54:54,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure 5edb26c74099296449ac252e8aa24185, server=jenkins-hbase4.apache.org,44869,1681055618167 in 176 msec 2023-04-09 15:54:54,187 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5edb26c74099296449ac252e8aa24185, ASSIGN in 336 msec 2023-04-09 15:54:54,192 DEBUG [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1 2023-04-09 15:54:54,192 DEBUG [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1 2023-04-09 15:54:54,192 INFO [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ae7083b5e65fccc3e4562ffb1cd8cdd columnFamilyName family1 2023-04-09 15:54:54,193 INFO [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] regionserver.HStore(310): Store=0ae7083b5e65fccc3e4562ffb1cd8cdd/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:54,193 INFO [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:54:54,195 DEBUG [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2 2023-04-09 15:54:54,195 DEBUG [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2 2023-04-09 15:54:54,195 INFO [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ae7083b5e65fccc3e4562ffb1cd8cdd columnFamilyName family2 2023-04-09 15:54:54,199 INFO [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] regionserver.HStore(310): Store=0ae7083b5e65fccc3e4562ffb1cd8cdd/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:54,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:54:54,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:54:54,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-09 15:54:54,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:54:54,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:54:54,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0ae7083b5e65fccc3e4562ffb1cd8cdd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67796185, jitterRate=0.010241881012916565}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-09 15:54:54,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0ae7083b5e65fccc3e4562ffb1cd8cdd: 2023-04-09 15:54:54,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd., pid=84, masterSystemTime=1681055694162 2023-04-09 15:54:54,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:54:54,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:54:54,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:54:54,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2720147230b846f05cd943c11531e895, NAME => 'testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895.', STARTKEY => '1', ENDKEY => '2'} 2023-04-09 15:54:54,228 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=0ae7083b5e65fccc3e4562ffb1cd8cdd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:54,228 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1681055694228"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055694228"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055694228"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055694228"}]},"ts":"1681055694228"} 2023-04-09 15:54:54,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 2720147230b846f05cd943c11531e895 2023-04-09 15:54:54,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:54:54,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2720147230b846f05cd943c11531e895 2023-04-09 15:54:54,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2720147230b846f05cd943c11531e895 2023-04-09 15:54:54,231 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=80 2023-04-09 15:54:54,231 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=80, state=SUCCESS; OpenRegionProcedure 0ae7083b5e65fccc3e4562ffb1cd8cdd, server=jenkins-hbase4.apache.org,44869,1681055618167 in 221 msec 2023-04-09 15:54:54,233 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ae7083b5e65fccc3e4562ffb1cd8cdd, ASSIGN in 383 msec 2023-04-09 15:54:54,233 INFO [StoreOpener-2720147230b846f05cd943c11531e895-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2720147230b846f05cd943c11531e895 2023-04-09 15:54:54,235 DEBUG [StoreOpener-2720147230b846f05cd943c11531e895-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1 2023-04-09 15:54:54,235 DEBUG [StoreOpener-2720147230b846f05cd943c11531e895-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1 2023-04-09 15:54:54,235 INFO [StoreOpener-2720147230b846f05cd943c11531e895-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2720147230b846f05cd943c11531e895 columnFamilyName family1 2023-04-09 15:54:54,237 INFO [StoreOpener-2720147230b846f05cd943c11531e895-1] regionserver.HStore(310): Store=2720147230b846f05cd943c11531e895/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:54,237 INFO [StoreOpener-2720147230b846f05cd943c11531e895-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2720147230b846f05cd943c11531e895 2023-04-09 15:54:54,238 DEBUG [StoreOpener-2720147230b846f05cd943c11531e895-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2 2023-04-09 15:54:54,238 DEBUG [StoreOpener-2720147230b846f05cd943c11531e895-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2 2023-04-09 15:54:54,239 INFO [StoreOpener-2720147230b846f05cd943c11531e895-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2720147230b846f05cd943c11531e895 columnFamilyName family2 2023-04-09 15:54:54,240 INFO [StoreOpener-2720147230b846f05cd943c11531e895-1] regionserver.HStore(310): Store=2720147230b846f05cd943c11531e895/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:54:54,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895 2023-04-09 15:54:54,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895 2023-04-09 15:54:54,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-09 15:54:54,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2720147230b846f05cd943c11531e895 2023-04-09 15:54:54,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:54:54,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2720147230b846f05cd943c11531e895; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74872528, jitterRate=0.11568760871887207}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-09 15:54:54,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2720147230b846f05cd943c11531e895: 2023-04-09 15:54:54,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895., pid=83, masterSystemTime=1681055694162 2023-04-09 15:54:54,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:54:54,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:54:54,256 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=2720147230b846f05cd943c11531e895, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:54,256 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1681055694256"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055694256"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055694256"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055694256"}]},"ts":"1681055694256"} 2023-04-09 15:54:54,259 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=81 2023-04-09 15:54:54,259 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure 2720147230b846f05cd943c11531e895, server=jenkins-hbase4.apache.org,44869,1681055618167 in 250 msec 2023-04-09 15:54:54,261 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=79 2023-04-09 15:54:54,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2720147230b846f05cd943c11531e895, ASSIGN in 411 msec 2023-04-09 15:54:54,262 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-09 15:54:54,262 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055694262"}]},"ts":"1681055694262"} 2023-04-09 15:54:54,263 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-04-09 15:54:54,267 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-04-09 15:54:54,268 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2780 sec 2023-04-09 15:54:55,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-04-09 15:54:55,097 INFO [Listener at localhost/39283] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-04-09 15:54:55,107 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:54:55,109 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:54:55,110 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:54:55,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:55,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-04-09 15:54:55,117 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-04-09 15:54:55,117 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:55,117 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-04-09 15:54:55,118 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-04-09 15:54:55,118 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:55,118 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:54:55,119 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:55,119 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:55,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:55,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:55,120 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:55,120 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:55,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:54:55,120 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:55,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:55,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:54:55,120 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-04-09 15:54:55,121 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-04-09 15:54:55,121 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-04-09 15:54:55,121 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:55,121 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-04-09 15:54:55,121 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:54:55,121 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. started... 2023-04-09 15:54:55,121 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:54:55,121 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. started... 2023-04-09 15:54:55,121 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-09 15:54:55,123 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:55,122 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5edb26c74099296449ac252e8aa24185 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-04-09 15:54:55,122 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:54:55,123 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0ae7083b5e65fccc3e4562ffb1cd8cdd 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-04-09 15:54:55,123 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. started... 2023-04-09 15:54:55,123 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2720147230b846f05cd943c11531e895 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-04-09 15:54:55,160 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409525e35a922af42e7bf71c42be5460e73 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409525e35a922af42e7bf71c42be5460e73 2023-04-09 15:54:55,166 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230409544d36343520473a9a86321189e90cf9 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230409544d36343520473a9a86321189e90cf9 2023-04-09 15:54:55,185 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family1/a9c534bcf81748ffa74639dbfd3e549f 2023-04-09 15:54:55,191 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family1/4fabf06a69a84990b1fe22deb6848ae3 2023-04-09 15:54:55,223 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409003d005d27df4c009520f850d2f6dffa to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409003d005d27df4c009520f850d2f6dffa 2023-04-09 15:54:55,554 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409e5f4bd2fe7b34bc1a6bfb070651d0ecd to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409e5f4bd2fe7b34bc1a6bfb070651d0ecd 2023-04-09 15:54:55,627 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023040945d19a1d67cd49039b65a39b72ea18fb to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040945d19a1d67cd49039b65a39b72ea18fb 2023-04-09 15:54:55,629 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family2/68c6f25961c94c86b3c801d041492736 2023-04-09 15:54:55,638 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family1/a9c534bcf81748ffa74639dbfd3e549f as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/a9c534bcf81748ffa74639dbfd3e549f 2023-04-09 15:54:55,642 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/a9c534bcf81748ffa74639dbfd3e549f, entries=4, sequenceid=5, filesize=5.4 K 2023-04-09 15:54:55,642 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family2/68c6f25961c94c86b3c801d041492736 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/68c6f25961c94c86b3c801d041492736 2023-04-09 15:54:55,646 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/68c6f25961c94c86b3c801d041492736, entries=2, sequenceid=5, filesize=5.1 K 2023-04-09 15:54:55,649 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0ae7083b5e65fccc3e4562ffb1cd8cdd in 526ms, sequenceid=5, compaction requested=false 2023-04-09 15:54:55,650 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-04-09 15:54:55,650 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0ae7083b5e65fccc3e4562ffb1cd8cdd: 2023-04-09 15:54:55,650 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:54:55,650 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-09 15:54:55,960 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family1/631c4c55741a4999a4a87883f7cad6aa 2023-04-09 15:54:56,034 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family2/6034a543e7964a0caf90eba11d97eb06 2023-04-09 15:54:56,039 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family1/4fabf06a69a84990b1fe22deb6848ae3 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/4fabf06a69a84990b1fe22deb6848ae3 2023-04-09 15:54:56,045 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/4fabf06a69a84990b1fe22deb6848ae3, entries=4, sequenceid=5, filesize=5.4 K 2023-04-09 15:54:56,046 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family2/6034a543e7964a0caf90eba11d97eb06 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/6034a543e7964a0caf90eba11d97eb06 2023-04-09 15:54:56,050 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/6034a543e7964a0caf90eba11d97eb06, entries=2, sequenceid=5, filesize=5.1 K 2023-04-09 15:54:56,051 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 2720147230b846f05cd943c11531e895 in 928ms, sequenceid=5, compaction requested=false 2023-04-09 15:54:56,052 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2720147230b846f05cd943c11531e895: 2023-04-09 15:54:56,052 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:54:56,052 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-09 15:54:56,378 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304091936b9f2f7c24634b5e00457cf56c263 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202304091936b9f2f7c24634b5e00457cf56c263 2023-04-09 15:54:56,386 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family2/48c8a7dae6bf41859cf8faf76194adcf 2023-04-09 15:54:56,390 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family1/631c4c55741a4999a4a87883f7cad6aa as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/631c4c55741a4999a4a87883f7cad6aa 2023-04-09 15:54:56,393 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/631c4c55741a4999a4a87883f7cad6aa, entries=4, sequenceid=5, filesize=5.4 K 2023-04-09 15:54:56,394 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family2/48c8a7dae6bf41859cf8faf76194adcf as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/48c8a7dae6bf41859cf8faf76194adcf 2023-04-09 15:54:56,397 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/48c8a7dae6bf41859cf8faf76194adcf, entries=2, sequenceid=5, filesize=5.1 K 2023-04-09 15:54:56,398 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 5edb26c74099296449ac252e8aa24185 in 1276ms, sequenceid=5, compaction requested=false 2023-04-09 15:54:56,398 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5edb26c74099296449ac252e8aa24185: 2023-04-09 15:54:56,398 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:54:56,399 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-09 15:54:56,399 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-09 15:54:56,399 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:56,399 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-04-09 15:54:56,399 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-04-09 15:54:56,400 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:56,400 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:56,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:56,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:56,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:56,401 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:56,401 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:56,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:56,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:56,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:54:56,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:56,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:56,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-04-09 15:54:56,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53adb6f2[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:56,402 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-04-09 15:54:56,402 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:56,403 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:56,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:56,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:56,403 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-04-09 15:54:56,403 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-04-09 15:54:56,403 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:56,403 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:56,403 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:56,406 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-04-09 15:54:56,406 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:56,406 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:56,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:56,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:56,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:56,406 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-04-09 15:54:56,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:56,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:56,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:54:56,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:56,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:56,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:54:56,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:56,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:56,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-04-09 15:54:56,409 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-04-09 15:54:56,409 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:56,409 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:56,409 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-04-09 15:54:56,409 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:56,410 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:56,410 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:56,410 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:56,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:56,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:56,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:56,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:56,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:56,411 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:56,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:56,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:56,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:56,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:54:56,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:56,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:56,412 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:56,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:54:56,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:56,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:56,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:54:56,414 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:56,414 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:56,414 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:54:56,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:56,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:56,414 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:56,414 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:56,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-04-09 15:54:56,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:56,414 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:54:56,414 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:56,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:56,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:56,414 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:56,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-04-09 15:54:56,414 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:56,414 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:56,414 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:56,415 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:56,515 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:56,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:56,517 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:54:56,517 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:54:56,517 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:54:56,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:56,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:56,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-04-09 15:54:56,530 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-04-09 15:54:56,530 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:56,530 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-04-09 15:54:56,530 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-04-09 15:54:56,531 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:56,531 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:54:56,532 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:56,532 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:56,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:56,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:56,533 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:56,533 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:56,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:54:56,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:56,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:56,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:54:56,535 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-04-09 15:54:56,542 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-04-09 15:54:56,542 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-04-09 15:54:56,542 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-04-09 15:54:56,542 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:56,542 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-04-09 15:54:56,543 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:54:56,543 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. started... 2023-04-09 15:54:56,543 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5edb26c74099296449ac252e8aa24185 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-04-09 15:54:56,543 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:54:56,543 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-09 15:54:56,543 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:56,543 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:54:56,543 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. started... 2023-04-09 15:54:56,544 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. started... 2023-04-09 15:54:56,544 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0ae7083b5e65fccc3e4562ffb1cd8cdd 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-04-09 15:54:56,544 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2720147230b846f05cd943c11531e895 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-04-09 15:54:56,574 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304098be8de8eb1514b8cbadbc106cd83b365 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304098be8de8eb1514b8cbadbc106cd83b365 2023-04-09 15:54:56,574 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023040938d91309f2d645ceae048ace07c171fb to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023040938d91309f2d645ceae048ace07c171fb 2023-04-09 15:54:56,967 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409d3db5ee0905a4d67b84c282558c90c9f to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409d3db5ee0905a4d67b84c282558c90c9f 2023-04-09 15:54:56,973 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family1/cb9685cb74004119a43bc3a46ba07f3c 2023-04-09 15:54:56,981 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family1/99243ed4dfad4f929375bf026305cf72 2023-04-09 15:54:56,981 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family1/46a363d96db148fa8e2a0428ef48e5de 2023-04-09 15:54:57,032 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304092b4f598569ba48068ad2239ed724e90d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202304092b4f598569ba48068ad2239ed724e90d 2023-04-09 15:54:57,049 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family2/27ea281ccac2403283dcc700b50f015d 2023-04-09 15:54:57,054 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family1/99243ed4dfad4f929375bf026305cf72 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/99243ed4dfad4f929375bf026305cf72 2023-04-09 15:54:57,058 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/99243ed4dfad4f929375bf026305cf72, entries=4, sequenceid=9, filesize=5.4 K 2023-04-09 15:54:57,059 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family2/27ea281ccac2403283dcc700b50f015d as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/27ea281ccac2403283dcc700b50f015d 2023-04-09 15:54:57,062 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/27ea281ccac2403283dcc700b50f015d, entries=2, sequenceid=9, filesize=5.1 K 2023-04-09 15:54:57,063 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 2720147230b846f05cd943c11531e895 in 519ms, sequenceid=9, compaction requested=false 2023-04-09 15:54:57,063 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2720147230b846f05cd943c11531e895: 2023-04-09 15:54:57,063 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:54:57,063 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-09 15:54:57,423 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409b41482bc0d454cf48286ad4087e61dbf to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409b41482bc0d454cf48286ad4087e61dbf 2023-04-09 15:54:57,445 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023040930aa45d7b8e24900b09a79ae930ab814 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023040930aa45d7b8e24900b09a79ae930ab814 2023-04-09 15:54:57,452 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family2/7af52dc4dd584035a1cab3ea5e64325a 2023-04-09 15:54:57,457 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family1/46a363d96db148fa8e2a0428ef48e5de as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/46a363d96db148fa8e2a0428ef48e5de 2023-04-09 15:54:57,460 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/46a363d96db148fa8e2a0428ef48e5de, entries=4, sequenceid=9, filesize=5.4 K 2023-04-09 15:54:57,461 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family2/7af52dc4dd584035a1cab3ea5e64325a as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/7af52dc4dd584035a1cab3ea5e64325a 2023-04-09 15:54:57,467 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/7af52dc4dd584035a1cab3ea5e64325a, entries=2, sequenceid=9, filesize=5.1 K 2023-04-09 15:54:57,468 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 5edb26c74099296449ac252e8aa24185 in 924ms, sequenceid=9, compaction requested=false 2023-04-09 15:54:57,468 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5edb26c74099296449ac252e8aa24185: 2023-04-09 15:54:57,468 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:54:57,468 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-09 15:54:57,829 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family2/6c675f47fcbe4664a2a107df6f673750 2023-04-09 15:54:57,834 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family1/cb9685cb74004119a43bc3a46ba07f3c as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/cb9685cb74004119a43bc3a46ba07f3c 2023-04-09 15:54:57,838 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/cb9685cb74004119a43bc3a46ba07f3c, entries=4, sequenceid=9, filesize=5.4 K 2023-04-09 15:54:57,839 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family2/6c675f47fcbe4664a2a107df6f673750 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/6c675f47fcbe4664a2a107df6f673750 2023-04-09 15:54:57,843 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/6c675f47fcbe4664a2a107df6f673750, entries=2, sequenceid=9, filesize=5.1 K 2023-04-09 15:54:57,844 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0ae7083b5e65fccc3e4562ffb1cd8cdd in 1300ms, sequenceid=9, compaction requested=false 2023-04-09 15:54:57,844 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0ae7083b5e65fccc3e4562ffb1cd8cdd: 2023-04-09 15:54:57,844 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:54:57,844 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-09 15:54:57,844 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-09 15:54:57,844 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:57,844 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-04-09 15:54:57,844 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-04-09 15:54:57,847 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:57,847 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:57,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:57,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:57,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:57,848 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:57,848 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:57,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:57,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:57,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:54:57,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:57,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:57,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-04-09 15:54:57,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a36aa33[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:57,849 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-04-09 15:54:57,849 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:57,850 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:57,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:57,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:57,851 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-04-09 15:54:57,851 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-04-09 15:54:57,851 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:57,851 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:57,851 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:57,852 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:57,852 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-04-09 15:54:57,852 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:57,852 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-04-09 15:54:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:57,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:57,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:57,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:54:57,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:54:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:57,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-04-09 15:54:57,855 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-04-09 15:54:57,855 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:57,855 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:57,855 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-04-09 15:54:57,855 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:57,856 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:57,856 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:57,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:57,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:57,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:57,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:57,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:57,857 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:57,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:57,857 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:57,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:57,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:57,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:54:57,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:57,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:54:57,860 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:57,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:54:57,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:57,863 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:57,863 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:54:57,863 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:57,863 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:57,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-04-09 15:54:57,863 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:57,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-04-09 15:54:57,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:57,863 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:54:57,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:57,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:57,863 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:57,864 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:57,864 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:57,864 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:57,864 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:57,864 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:57,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:57,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:57,964 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:57,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:57,966 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:54:57,967 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:54:57,967 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:54:57,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:57,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:57,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-04-09 15:54:57,972 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-04-09 15:54:57,972 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:57,972 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-04-09 15:54:57,972 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-04-09 15:54:57,973 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:57,973 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:54:57,974 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:57,974 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:57,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:57,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:57,975 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:57,975 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:57,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:54:57,975 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:57,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:57,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:54:57,976 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-04-09 15:54:57,976 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-04-09 15:54:57,976 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-04-09 15:54:57,976 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-04-09 15:54:57,976 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:57,976 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-04-09 15:54:57,977 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:54:57,977 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. started... 2023-04-09 15:54:57,977 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-09 15:54:57,977 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5edb26c74099296449ac252e8aa24185 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-04-09 15:54:57,977 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:54:57,977 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:54:57,977 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:57,977 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. started... 2023-04-09 15:54:57,977 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. started... 2023-04-09 15:54:57,978 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2720147230b846f05cd943c11531e895 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-04-09 15:54:57,978 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0ae7083b5e65fccc3e4562ffb1cd8cdd 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-04-09 15:54:58,043 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409f0eec9b8918e4ede924f48521003bc95 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409f0eec9b8918e4ede924f48521003bc95 2023-04-09 15:54:58,061 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304095976a4b334664952a003191ed0db432e to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304095976a4b334664952a003191ed0db432e 2023-04-09 15:54:58,066 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409ea6b65a7d4ba48299de583656fe52652 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409ea6b65a7d4ba48299de583656fe52652 2023-04-09 15:54:58,204 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-09 15:54:58,465 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family1/27bfe4cf580941419fe1ee530dad30ed 2023-04-09 15:54:58,486 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family1/9fa1549e2a5f49faa4929250f248676b 2023-04-09 15:54:58,494 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family1/dbd4ed5695eb4e669873d652ee7ab056 2023-04-09 15:54:58,504 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023040985a9118f4dd5412385de39a64fafaab5 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040985a9118f4dd5412385de39a64fafaab5 2023-04-09 15:54:58,517 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304094d8bc058805f43e0819c7793cbfba51f to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202304094d8bc058805f43e0819c7793cbfba51f 2023-04-09 15:54:58,522 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family2/4147cd65e2a64a2abefea0a7610470a2 2023-04-09 15:54:58,528 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family1/dbd4ed5695eb4e669873d652ee7ab056 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/dbd4ed5695eb4e669873d652ee7ab056 2023-04-09 15:54:58,533 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/dbd4ed5695eb4e669873d652ee7ab056, entries=4, sequenceid=13, filesize=5.4 K 2023-04-09 15:54:58,534 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family2/4147cd65e2a64a2abefea0a7610470a2 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/4147cd65e2a64a2abefea0a7610470a2 2023-04-09 15:54:58,538 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/4147cd65e2a64a2abefea0a7610470a2, entries=2, sequenceid=13, filesize=5.1 K 2023-04-09 15:54:58,538 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0ae7083b5e65fccc3e4562ffb1cd8cdd in 560ms, sequenceid=13, compaction requested=true 2023-04-09 15:54:58,539 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0ae7083b5e65fccc3e4562ffb1cd8cdd: 2023-04-09 15:54:58,539 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:54:58,539 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-09 15:54:58,882 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409830a944cf3ad49e5b01ef8ffa67bdccb to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230409830a944cf3ad49e5b01ef8ffa67bdccb 2023-04-09 15:54:58,912 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family2/45a8253ed7304a0997bd5d42d5fe6ecf 2023-04-09 15:54:58,917 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family1/9fa1549e2a5f49faa4929250f248676b as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/9fa1549e2a5f49faa4929250f248676b 2023-04-09 15:54:58,920 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/9fa1549e2a5f49faa4929250f248676b, entries=4, sequenceid=13, filesize=5.4 K 2023-04-09 15:54:58,921 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family2/45a8253ed7304a0997bd5d42d5fe6ecf as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/45a8253ed7304a0997bd5d42d5fe6ecf 2023-04-09 15:54:58,925 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/45a8253ed7304a0997bd5d42d5fe6ecf, entries=2, sequenceid=13, filesize=5.1 K 2023-04-09 15:54:58,926 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 2720147230b846f05cd943c11531e895 in 948ms, sequenceid=13, compaction requested=true 2023-04-09 15:54:58,926 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2720147230b846f05cd943c11531e895: 2023-04-09 15:54:58,926 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:54:58,926 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-09 15:54:59,288 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family2/72e08a32ca9a4e97840a12454ee021e6 2023-04-09 15:54:59,293 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family1/27bfe4cf580941419fe1ee530dad30ed as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/27bfe4cf580941419fe1ee530dad30ed 2023-04-09 15:54:59,297 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/27bfe4cf580941419fe1ee530dad30ed, entries=4, sequenceid=13, filesize=5.4 K 2023-04-09 15:54:59,297 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family2/72e08a32ca9a4e97840a12454ee021e6 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/72e08a32ca9a4e97840a12454ee021e6 2023-04-09 15:54:59,303 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/72e08a32ca9a4e97840a12454ee021e6, entries=2, sequenceid=13, filesize=5.1 K 2023-04-09 15:54:59,304 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 5edb26c74099296449ac252e8aa24185 in 1327ms, sequenceid=13, compaction requested=true 2023-04-09 15:54:59,304 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5edb26c74099296449ac252e8aa24185: 2023-04-09 15:54:59,304 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:54:59,304 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-09 15:54:59,304 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-09 15:54:59,304 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:59,304 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-04-09 15:54:59,304 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-04-09 15:54:59,306 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:59,306 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:59,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:59,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:59,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:59,306 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:59,306 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:54:59,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:59,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:59,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:54:59,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:59,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:59,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-04-09 15:54:59,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@209ef368[Count = 0] remaining members to acquire global barrier 2023-04-09 15:54:59,308 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-04-09 15:54:59,308 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:59,309 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:59,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:59,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:59,309 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-04-09 15:54:59,309 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-04-09 15:54:59,309 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:54:59,309 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:59,309 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:54:59,316 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:59,316 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-04-09 15:54:59,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:59,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:59,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:59,316 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:59,316 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-04-09 15:54:59,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:59,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:59,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:54:59,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:59,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:59,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:54:59,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:59,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:54:59,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-04-09 15:54:59,319 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-04-09 15:54:59,319 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:54:59,319 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:54:59,319 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-04-09 15:54:59,319 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:54:59,321 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:59,321 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:59,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:59,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:59,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:54:59,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:54:59,321 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:59,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:59,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:54:59,322 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:59,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:54:59,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:59,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:59,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:54:59,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:59,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:54:59,323 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:59,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:59,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:54:59,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:54:59,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:59,326 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:59,327 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:54:59,327 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:54:59,327 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:59,327 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:59,327 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:59,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:59,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:59,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-04-09 15:54:59,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:54:59,327 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:54:59,327 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:54:59,327 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:54:59,327 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:59,327 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-04-09 15:54:59,327 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-04-09 15:54:59,327 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:54:59,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:54:59,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:54:59,428 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:54:59,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:54:59,430 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:54:59,430 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:54:59,430 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:54:59,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:54:59,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-04-09 15:54:59,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-04-09 15:54:59,435 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-04-09 15:54:59,435 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:59,435 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-04-09 15:54:59,435 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-04-09 15:54:59,436 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:59,437 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:54:59,438 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:54:59,438 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:59,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:54:59,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:54:59,438 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:54:59,438 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:54:59,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:54:59,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:54:59,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:54:59,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:54:59,439 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-04-09 15:54:59,439 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-04-09 15:54:59,439 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-04-09 15:54:59,439 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-04-09 15:54:59,439 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:54:59,439 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-04-09 15:54:59,440 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:54:59,440 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. started... 2023-04-09 15:54:59,441 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:54:59,441 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5edb26c74099296449ac252e8aa24185 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-04-09 15:54:59,441 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. started... 2023-04-09 15:54:59,441 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0ae7083b5e65fccc3e4562ffb1cd8cdd 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-04-09 15:54:59,444 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-09 15:54:59,444 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:54:59,444 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:54:59,444 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. started... 2023-04-09 15:54:59,444 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2720147230b846f05cd943c11531e895 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-04-09 15:54:59,510 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023040908d0dfb685444d24bf8e997250823d01 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023040908d0dfb685444d24bf8e997250823d01 2023-04-09 15:54:59,522 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family1/822ee823e4704e678dc7b6d68699ab72 2023-04-09 15:54:59,888 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409a029596bc9cc4e35be5c80b0dd75d03b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409a029596bc9cc4e35be5c80b0dd75d03b 2023-04-09 15:54:59,911 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023040931ad9321e8674aa8991061368bf3b1d4 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023040931ad9321e8674aa8991061368bf3b1d4 2023-04-09 15:54:59,941 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409163ef4ed67e94e0789fdb43264487fa2 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409163ef4ed67e94e0789fdb43264487fa2 2023-04-09 15:54:59,954 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family2/5da236d0b4594212b2891d90a7b41877 2023-04-09 15:54:59,958 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family1/822ee823e4704e678dc7b6d68699ab72 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/822ee823e4704e678dc7b6d68699ab72 2023-04-09 15:54:59,963 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/822ee823e4704e678dc7b6d68699ab72, entries=4, sequenceid=17, filesize=5.4 K 2023-04-09 15:54:59,964 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family2/5da236d0b4594212b2891d90a7b41877 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/5da236d0b4594212b2891d90a7b41877 2023-04-09 15:54:59,969 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/5da236d0b4594212b2891d90a7b41877, entries=2, sequenceid=17, filesize=5.1 K 2023-04-09 15:54:59,970 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0ae7083b5e65fccc3e4562ffb1cd8cdd in 529ms, sequenceid=17, compaction requested=true 2023-04-09 15:54:59,970 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0ae7083b5e65fccc3e4562ffb1cd8cdd: 2023-04-09 15:54:59,970 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:54:59,970 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-09 15:55:00,307 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family1/ff23ebbd09f64cd09a309c5eacd98052 2023-04-09 15:55:00,321 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family1/ea11e2e967494f6ab6e9f3eb6ab26e68 2023-04-09 15:55:00,336 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230409434a4cd1e64a41479e8b9c5774fa14b3 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230409434a4cd1e64a41479e8b9c5774fa14b3 2023-04-09 15:55:00,343 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family2/8514d9964a5341a690c8eb6f47af97ba 2023-04-09 15:55:00,347 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family1/ea11e2e967494f6ab6e9f3eb6ab26e68 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/ea11e2e967494f6ab6e9f3eb6ab26e68 2023-04-09 15:55:00,352 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/ea11e2e967494f6ab6e9f3eb6ab26e68, entries=4, sequenceid=17, filesize=5.4 K 2023-04-09 15:55:00,353 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family2/8514d9964a5341a690c8eb6f47af97ba as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8514d9964a5341a690c8eb6f47af97ba 2023-04-09 15:55:00,357 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8514d9964a5341a690c8eb6f47af97ba, entries=2, sequenceid=17, filesize=5.1 K 2023-04-09 15:55:00,358 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 2720147230b846f05cd943c11531e895 in 914ms, sequenceid=17, compaction requested=true 2023-04-09 15:55:00,358 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2720147230b846f05cd943c11531e895: 2023-04-09 15:55:00,358 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:00,358 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-09 15:55:00,735 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409e22e2f086b4b4d28a8376e3473963289 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230409e22e2f086b4b4d28a8376e3473963289 2023-04-09 15:55:00,740 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family2/9f6f733a0a1949c78db20b5e3437aba1 2023-04-09 15:55:00,744 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family1/ff23ebbd09f64cd09a309c5eacd98052 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/ff23ebbd09f64cd09a309c5eacd98052 2023-04-09 15:55:00,761 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/ff23ebbd09f64cd09a309c5eacd98052, entries=4, sequenceid=17, filesize=5.4 K 2023-04-09 15:55:00,762 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family2/9f6f733a0a1949c78db20b5e3437aba1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/9f6f733a0a1949c78db20b5e3437aba1 2023-04-09 15:55:00,773 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/9f6f733a0a1949c78db20b5e3437aba1, entries=2, sequenceid=17, filesize=5.1 K 2023-04-09 15:55:00,774 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 5edb26c74099296449ac252e8aa24185 in 1333ms, sequenceid=17, compaction requested=true 2023-04-09 15:55:00,774 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5edb26c74099296449ac252e8aa24185: 2023-04-09 15:55:00,774 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:00,774 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-09 15:55:00,774 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-09 15:55:00,774 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:00,774 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-04-09 15:55:00,774 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-04-09 15:55:00,782 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:00,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:00,782 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:55:00,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:00,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:00,782 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:55:00,782 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:00,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:00,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:00,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:55:00,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:00,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:00,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-04-09 15:55:00,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f5f869a[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:00,784 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-04-09 15:55:00,784 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:55:00,785 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:55:00,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:55:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:55:00,785 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-04-09 15:55:00,786 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-04-09 15:55:00,786 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:00,786 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:00,786 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:00,787 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:00,787 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-04-09 15:55:00,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:00,787 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:00,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:00,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:00,787 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-04-09 15:55:00,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:00,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:00,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:55:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:55:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:00,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:00,790 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-04-09 15:55:00,790 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:00,790 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:00,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-04-09 15:55:00,790 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-04-09 15:55:00,790 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:00,792 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:55:00,792 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:00,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:55:00,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:55:00,792 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:55:00,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:55:00,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:00,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:00,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:00,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:00,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:00,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:55:00,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:55:00,793 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:00,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:55:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:00,795 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:00,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:55:00,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:00,798 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:00,798 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:55:00,798 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:55:00,798 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:00,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-04-09 15:55:00,798 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:00,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:00,798 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:55:00,798 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:00,799 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:55:00,799 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:55:00,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:00,799 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:00,798 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:00,799 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:00,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:00,899 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:00,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:00,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1681055700900 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-04-09 15:55:00,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1681055700912 (current time:1681055700912). 2023-04-09 15:55:00,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-04-09 15:55:00,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] zookeeper.ReadOnlyZKClient(139): Connect 0x3863fd69 to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:55:00,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21cae6b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:55:00,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:55:00,929 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:55:00,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3863fd69 to 127.0.0.1:64813 2023-04-09 15:55:00,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:55:00,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-04-09 15:55:00,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1681055700900 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-04-09 15:55:00,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-04-09 15:55:00,941 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-04-09 15:55:00,941 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1681056300941 2023-04-09 15:55:00,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1681055700900 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-04-09 15:55:00,955 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1681055700900 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-04-09 15:55:00,958 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1681055700900 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:00,958 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-04-09 15:55:00,959 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-04-09 15:55:00,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-04-09 15:55:00,960 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 20 msec 2023-04-09 15:55:00,961 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-04-09 15:55:00,962 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1681056300962 2023-04-09 15:55:01,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1681055700900 2023-04-09 15:55:01,020 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1681055700900' 2023-04-09 15:55:01,020 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-04-09 15:55:01,020 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1681055700900' starting 'acquire' 2023-04-09 15:55:01,020 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1681055700900', kicking off acquire phase on members. 2023-04-09 15:55:01,020 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1681055700900 2023-04-09 15:55:01,021 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1681055700900 2023-04-09 15:55:01,022 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-04-09 15:55:01,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-04-09 15:55:01,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-04-09 15:55:01,023 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1681055700900/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:01,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1681055700900 2023-04-09 15:55:01,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1681055700900 2023-04-09 15:55:01,023 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1681055700900/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:01,023 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:01,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-04-09 15:55:01,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1681055700900 2023-04-09 15:55:01,024 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1681055700900 from table testCompactionWithHFileLink type FLUSH 2023-04-09 15:55:01,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1681055700900 2023-04-09 15:55:01,028 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1681055700900' with timeout 300000ms 2023-04-09 15:55:01,028 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-04-09 15:55:01,028 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1681055700900' starting 'acquire' stage 2023-04-09 15:55:01,028 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1681055700900' locally acquired 2023-04-09 15:55:01,028 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (snaptb-1681055700900) in zk 2023-04-09 15:55:01,035 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1681055700900/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:01,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1681055700900/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:01,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:01,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-04-09 15:55:01,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:01,035 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1681055700900 2023-04-09 15:55:01,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:01,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1681055700900 2023-04-09 15:55:01,036 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1681055700900 2023-04-09 15:55:01,036 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1681055700900' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:01,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:01,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:01,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'snaptb-1681055700900' on coordinator 2023-04-09 15:55:01,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71fbb3a5[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:01,037 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1681055700900' starting 'in-barrier' execution. 2023-04-09 15:55:01,037 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1681055700900 2023-04-09 15:55:01,038 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1681055700900 2023-04-09 15:55:01,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1681055700900 2023-04-09 15:55:01,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1681055700900 2023-04-09 15:55:01,038 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1681055700900' received 'reached' from coordinator. 2023-04-09 15:55:01,038 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1681055700900/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:01,039 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:01,049 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:01,050 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. started... 2023-04-09 15:55:01,050 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5edb26c74099296449ac252e8aa24185: 2023-04-09 15:55:01,051 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185.' region-info for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,052 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:01,052 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. started... 2023-04-09 15:55:01,052 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 0ae7083b5e65fccc3e4562ffb1cd8cdd: 2023-04-09 15:55:01,053 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd.' region-info for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,053 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-04-09 15:55:01,053 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:01,053 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. started... 2023-04-09 15:55:01,053 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-04-09 15:55:01,054 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 2720147230b846f05cd943c11531e895: 2023-04-09 15:55:01,054 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895.' region-info for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,058 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-09 15:55:01,059 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-04-09 15:55:01,060 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-04-09 15:55:01,060 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-04-09 15:55:01,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1681055700900 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-09 15:55:01,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1681055700900 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-04-09 15:55:01,064 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-04-09 15:55:01,064 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/4fabf06a69a84990b1fe22deb6848ae3, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/99243ed4dfad4f929375bf026305cf72, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/9fa1549e2a5f49faa4929250f248676b, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/ea11e2e967494f6ab6e9f3eb6ab26e68] hfiles 2023-04-09 15:55:01,064 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/a9c534bcf81748ffa74639dbfd3e549f, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/cb9685cb74004119a43bc3a46ba07f3c, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/dbd4ed5695eb4e669873d652ee7ab056, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/822ee823e4704e678dc7b6d68699ab72] hfiles 2023-04-09 15:55:01,064 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/631c4c55741a4999a4a87883f7cad6aa, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/46a363d96db148fa8e2a0428ef48e5de, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/27bfe4cf580941419fe1ee530dad30ed, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/ff23ebbd09f64cd09a309c5eacd98052] hfiles 2023-04-09 15:55:01,064 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/631c4c55741a4999a4a87883f7cad6aa for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,064 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/a9c534bcf81748ffa74639dbfd3e549f for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,064 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/4fabf06a69a84990b1fe22deb6848ae3 for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,068 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/46a363d96db148fa8e2a0428ef48e5de for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,068 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/99243ed4dfad4f929375bf026305cf72 for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,069 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/9fa1549e2a5f49faa4929250f248676b for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,069 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/ea11e2e967494f6ab6e9f3eb6ab26e68 for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,069 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/6034a543e7964a0caf90eba11d97eb06, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/27ea281ccac2403283dcc700b50f015d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/45a8253ed7304a0997bd5d42d5fe6ecf, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8514d9964a5341a690c8eb6f47af97ba] hfiles 2023-04-09 15:55:01,069 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/6034a543e7964a0caf90eba11d97eb06 for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,069 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/27ea281ccac2403283dcc700b50f015d for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,069 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/45a8253ed7304a0997bd5d42d5fe6ecf for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,069 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8514d9964a5341a690c8eb6f47af97ba for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,068 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/27bfe4cf580941419fe1ee530dad30ed for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,070 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/ff23ebbd09f64cd09a309c5eacd98052 for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,070 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/48c8a7dae6bf41859cf8faf76194adcf, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/7af52dc4dd584035a1cab3ea5e64325a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/72e08a32ca9a4e97840a12454ee021e6, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/9f6f733a0a1949c78db20b5e3437aba1] hfiles 2023-04-09 15:55:01,069 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/cb9685cb74004119a43bc3a46ba07f3c for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,070 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/48c8a7dae6bf41859cf8faf76194adcf for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,070 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/dbd4ed5695eb4e669873d652ee7ab056 for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,070 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/7af52dc4dd584035a1cab3ea5e64325a for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,070 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/822ee823e4704e678dc7b6d68699ab72 for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,070 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/72e08a32ca9a4e97840a12454ee021e6 for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,070 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/68c6f25961c94c86b3c801d041492736, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/6c675f47fcbe4664a2a107df6f673750, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/4147cd65e2a64a2abefea0a7610470a2, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/5da236d0b4594212b2891d90a7b41877] hfiles 2023-04-09 15:55:01,070 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/68c6f25961c94c86b3c801d041492736 for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,070 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/9f6f733a0a1949c78db20b5e3437aba1 for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,070 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/6c675f47fcbe4664a2a107df6f673750 for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,070 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/4147cd65e2a64a2abefea0a7610470a2 for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,070 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/5da236d0b4594212b2891d90a7b41877 for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,264 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-09 15:55:01,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1681055700900 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-09 15:55:01,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1681055700900 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-04-09 15:55:01,265 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-04-09 15:55:01,500 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. completed. 2023-04-09 15:55:01,500 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:01,501 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-04-09 15:55:01,508 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. completed. 2023-04-09 15:55:01,509 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:01,509 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-04-09 15:55:01,509 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. completed. 2023-04-09 15:55:01,509 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:01,509 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-04-09 15:55:01,509 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-04-09 15:55:01,509 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:01,509 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1681055700900' locally completed 2023-04-09 15:55:01,509 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1681055700900' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:01,511 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1681055700900/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:01,511 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1681055700900' has notified controller of completion 2023-04-09 15:55:01,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1681055700900/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:01,511 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:01,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:01,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-04-09 15:55:01,511 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1681055700900' completed. 2023-04-09 15:55:01,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1681055700900 2023-04-09 15:55:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:01,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:01,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1681055700900 2023-04-09 15:55:01,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:01,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1681055700900' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:01,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'snaptb-1681055700900', counting down latch. Waiting for 0 more 2023-04-09 15:55:01,514 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1681055700900' execution completed 2023-04-09 15:55:01,514 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:01,514 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:01,514 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1681055700900 2023-04-09 15:55:01,514 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1681055700900including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-04-09 15:55:01,516 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1681055700900 2023-04-09 15:55:01,516 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1681055700900 2023-04-09 15:55:01,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1681055700900 2023-04-09 15:55:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1681055700900 2023-04-09 15:55:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-04-09 15:55:01,516 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-04-09 15:55:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1681055700900 2023-04-09 15:55:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:01,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-04-09 15:55:01,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-04-09 15:55:01,517 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1681055700900/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:01,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1681055700900 2023-04-09 15:55:01,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1681055700900 2023-04-09 15:55:01,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:01,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1681055700900 2023-04-09 15:55:01,518 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1681055700900/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:01,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:01,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1681055700900 2023-04-09 15:55:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:01,521 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-04-09 15:55:01,521 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1681055700900/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:01,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-04-09 15:55:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-04-09 15:55:01,521 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1681055700900 2023-04-09 15:55:01,522 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1681055700900 2023-04-09 15:55:01,522 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1681055700900 2023-04-09 15:55:01,522 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-04-09 15:55:01,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1681055700900 2023-04-09 15:55:01,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-04-09 15:55:01,521 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-04-09 15:55:01,522 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1681055700900/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:01,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-04-09 15:55:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-04-09 15:55:01,522 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:01,522 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1681055700900 2023-04-09 15:55:01,523 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1681055700900 2023-04-09 15:55:01,523 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1681055700900 2023-04-09 15:55:01,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023040931ad9321e8674aa8991061368bf3b1d4, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230409544d36343520473a9a86321189e90cf9, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304095976a4b334664952a003191ed0db432e, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304098be8de8eb1514b8cbadbc106cd83b365, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023040938d91309f2d645ceae048ace07c171fb, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409a029596bc9cc4e35be5c80b0dd75d03b, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409e5f4bd2fe7b34bc1a6bfb070651d0ecd, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409f0eec9b8918e4ede924f48521003bc95, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023040908d0dfb685444d24bf8e997250823d01, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409525e35a922af42e7bf71c42be5460e73, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409d3db5ee0905a4d67b84c282558c90c9f, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409ea6b65a7d4ba48299de583656fe52652] mob files 2023-04-09 15:55:01,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023040931ad9321e8674aa8991061368bf3b1d4 2023-04-09 15:55:01,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230409544d36343520473a9a86321189e90cf9 2023-04-09 15:55:01,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304095976a4b334664952a003191ed0db432e 2023-04-09 15:55:01,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304098be8de8eb1514b8cbadbc106cd83b365 2023-04-09 15:55:01,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023040938d91309f2d645ceae048ace07c171fb 2023-04-09 15:55:01,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409a029596bc9cc4e35be5c80b0dd75d03b 2023-04-09 15:55:01,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409e5f4bd2fe7b34bc1a6bfb070651d0ecd 2023-04-09 15:55:01,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409f0eec9b8918e4ede924f48521003bc95 2023-04-09 15:55:01,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023040908d0dfb685444d24bf8e997250823d01 2023-04-09 15:55:01,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409525e35a922af42e7bf71c42be5460e73 2023-04-09 15:55:01,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409d3db5ee0905a4d67b84c282558c90c9f 2023-04-09 15:55:01,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409ea6b65a7d4ba48299de583656fe52652 2023-04-09 15:55:01,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202304092b4f598569ba48068ad2239ed724e90d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230409434a4cd1e64a41479e8b9c5774fa14b3, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040945d19a1d67cd49039b65a39b72ea18fb, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040985a9118f4dd5412385de39a64fafaab5, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202304091936b9f2f7c24634b5e00457cf56c263, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023040930aa45d7b8e24900b09a79ae930ab814, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230409830a944cf3ad49e5b01ef8ffa67bdccb, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230409e22e2f086b4b4d28a8376e3473963289, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409003d005d27df4c009520f850d2f6dffa, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409163ef4ed67e94e0789fdb43264487fa2, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202304094d8bc058805f43e0819c7793cbfba51f, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409b41482bc0d454cf48286ad4087e61dbf] mob files 2023-04-09 15:55:01,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202304092b4f598569ba48068ad2239ed724e90d 2023-04-09 15:55:01,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230409434a4cd1e64a41479e8b9c5774fa14b3 2023-04-09 15:55:01,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040945d19a1d67cd49039b65a39b72ea18fb 2023-04-09 15:55:01,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040985a9118f4dd5412385de39a64fafaab5 2023-04-09 15:55:01,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202304091936b9f2f7c24634b5e00457cf56c263 2023-04-09 15:55:01,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023040930aa45d7b8e24900b09a79ae930ab814 2023-04-09 15:55:01,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230409830a944cf3ad49e5b01ef8ffa67bdccb 2023-04-09 15:55:01,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230409e22e2f086b4b4d28a8376e3473963289 2023-04-09 15:55:01,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409003d005d27df4c009520f850d2f6dffa 2023-04-09 15:55:01,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409163ef4ed67e94e0789fdb43264487fa2 2023-04-09 15:55:01,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202304094d8bc058805f43e0819c7793cbfba51f 2023-04-09 15:55:01,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409b41482bc0d454cf48286ad4087e61dbf 2023-04-09 15:55:01,565 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-09 15:55:01,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1681055700900 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-09 15:55:01,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1681055700900 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-04-09 15:55:01,567 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-04-09 15:55:01,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1681055700900 2023-04-09 15:55:01,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.hbase-snapshot/.tmp/snaptb-1681055700900 2023-04-09 15:55:02,067 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-09 15:55:02,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1681055700900 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-09 15:55:02,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1681055700900 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-04-09 15:55:02,068 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-04-09 15:55:02,402 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.hbase-snapshot/.tmp/snaptb-1681055700900 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.hbase-snapshot/snaptb-1681055700900 2023-04-09 15:55:02,441 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1681055700900 of table testCompactionWithHFileLink completed 2023-04-09 15:55:02,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.hbase-snapshot/.tmp/snaptb-1681055700900 2023-04-09 15:55:02,442 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.hbase-snapshot/.tmp/snaptb-1681055700900 2023-04-09 15:55:02,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1681055700900 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1681055700955Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1681055701933 (+978 ms)Consolidate snapshot: snaptb-1681055700900 at 1681055701933Loading Region manifests for snaptb-1681055700900 at 1681055701933Writing data manifest for snaptb-1681055700900 at 1681055701948 (+15 ms)Verifying snapshot: snaptb-1681055700900 at 1681055702365 (+417 ms)Snapshot snaptb-1681055700900 of table testCompactionWithHFileLink completed at 1681055702441 (+76 ms) 2023-04-09 15:55:02,443 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-04-09 15:55:02,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.4830 sec 2023-04-09 15:55:03,068 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-09 15:55:03,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1681055700900 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-09 15:55:03,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1681055700900 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-04-09 15:55:03,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:03,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-04-09 15:55:03,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-04-09 15:55:03,121 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-04-09 15:55:03,121 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:03,121 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-04-09 15:55:03,121 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-04-09 15:55:03,122 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:55:03,122 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:55:03,123 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:03,123 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:03,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:03,123 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:03,123 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:03,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:03,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:55:03,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:55:03,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:03,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:55:03,124 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-04-09 15:55:03,125 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-04-09 15:55:03,125 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-04-09 15:55:03,125 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-04-09 15:55:03,125 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:03,125 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-04-09 15:55:03,125 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:03,125 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:03,125 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. started... 2023-04-09 15:55:03,125 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. started... 2023-04-09 15:55:03,125 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0ae7083b5e65fccc3e4562ffb1cd8cdd 2/2 column families, dataSize=138 B heapSize=944 B 2023-04-09 15:55:03,125 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5edb26c74099296449ac252e8aa24185 2/2 column families, dataSize=138 B heapSize=944 B 2023-04-09 15:55:03,126 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-09 15:55:03,126 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:03,126 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:03,126 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. started... 2023-04-09 15:55:03,126 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2720147230b846f05cd943c11531e895 2/2 column families, dataSize=138 B heapSize=944 B 2023-04-09 15:55:03,206 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family1/6a75675f3f88470d99cb623eb8b2a8ba 2023-04-09 15:55:03,210 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a75675f3f88470d99cb623eb8b2a8ba 2023-04-09 15:55:04,001 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family1/44934e434dcb4993a5f4bbb3c38199d1 2023-04-09 15:55:04,005 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44934e434dcb4993a5f4bbb3c38199d1 2023-04-09 15:55:04,024 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family1/261051335a334f91bcd3a39be5d3e690 2023-04-09 15:55:04,029 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 261051335a334f91bcd3a39be5d3e690 2023-04-09 15:55:04,038 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family2/9fe9f91c916a4556a2ec31964ecf85c6 2023-04-09 15:55:04,043 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9fe9f91c916a4556a2ec31964ecf85c6 2023-04-09 15:55:04,043 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family1/6a75675f3f88470d99cb623eb8b2a8ba as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/6a75675f3f88470d99cb623eb8b2a8ba 2023-04-09 15:55:04,048 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a75675f3f88470d99cb623eb8b2a8ba 2023-04-09 15:55:04,048 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/6a75675f3f88470d99cb623eb8b2a8ba, entries=3, sequenceid=24, filesize=5.0 K 2023-04-09 15:55:04,049 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family2/9fe9f91c916a4556a2ec31964ecf85c6 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/9fe9f91c916a4556a2ec31964ecf85c6 2023-04-09 15:55:04,070 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9fe9f91c916a4556a2ec31964ecf85c6 2023-04-09 15:55:04,070 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/9fe9f91c916a4556a2ec31964ecf85c6, entries=1, sequenceid=24, filesize=5.0 K 2023-04-09 15:55:04,071 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 5edb26c74099296449ac252e8aa24185 in 946ms, sequenceid=24, compaction requested=true 2023-04-09 15:55:04,071 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5edb26c74099296449ac252e8aa24185: 2023-04-09 15:55:04,071 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:04,071 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-09 15:55:04,477 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family2/8a5d5d81e7a9489a92a6555d4e920755 2023-04-09 15:55:04,481 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8a5d5d81e7a9489a92a6555d4e920755 2023-04-09 15:55:04,481 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family1/261051335a334f91bcd3a39be5d3e690 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/261051335a334f91bcd3a39be5d3e690 2023-04-09 15:55:04,485 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 261051335a334f91bcd3a39be5d3e690 2023-04-09 15:55:04,486 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/261051335a334f91bcd3a39be5d3e690, entries=3, sequenceid=24, filesize=5.0 K 2023-04-09 15:55:04,486 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family2/8a5d5d81e7a9489a92a6555d4e920755 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8a5d5d81e7a9489a92a6555d4e920755 2023-04-09 15:55:04,490 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8a5d5d81e7a9489a92a6555d4e920755 2023-04-09 15:55:04,490 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8a5d5d81e7a9489a92a6555d4e920755, entries=1, sequenceid=24, filesize=5.0 K 2023-04-09 15:55:04,491 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 2720147230b846f05cd943c11531e895 in 1365ms, sequenceid=24, compaction requested=true 2023-04-09 15:55:04,491 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2720147230b846f05cd943c11531e895: 2023-04-09 15:55:04,491 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:04,491 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-09 15:55:04,850 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family2/2e116b44ef734fc08daefcd87b14f954 2023-04-09 15:55:04,854 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e116b44ef734fc08daefcd87b14f954 2023-04-09 15:55:04,855 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family1/44934e434dcb4993a5f4bbb3c38199d1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/44934e434dcb4993a5f4bbb3c38199d1 2023-04-09 15:55:04,858 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44934e434dcb4993a5f4bbb3c38199d1 2023-04-09 15:55:04,858 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/44934e434dcb4993a5f4bbb3c38199d1, entries=3, sequenceid=24, filesize=5.0 K 2023-04-09 15:55:04,859 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family2/2e116b44ef734fc08daefcd87b14f954 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/2e116b44ef734fc08daefcd87b14f954 2023-04-09 15:55:04,863 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e116b44ef734fc08daefcd87b14f954 2023-04-09 15:55:04,863 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/2e116b44ef734fc08daefcd87b14f954, entries=1, sequenceid=24, filesize=5.0 K 2023-04-09 15:55:04,864 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0ae7083b5e65fccc3e4562ffb1cd8cdd in 1739ms, sequenceid=24, compaction requested=true 2023-04-09 15:55:04,864 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0ae7083b5e65fccc3e4562ffb1cd8cdd: 2023-04-09 15:55:04,864 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:04,864 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-09 15:55:04,864 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-09 15:55:04,864 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:04,864 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-04-09 15:55:04,864 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-04-09 15:55:04,866 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:55:04,866 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:04,866 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:55:04,866 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:04,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:04,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:04,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:04,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:04,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:04,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:55:04,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:04,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:04,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-04-09 15:55:04,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e63f89b[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:04,868 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-04-09 15:55:04,868 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:55:04,869 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:55:04,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:55:04,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:55:04,869 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-04-09 15:55:04,869 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-04-09 15:55:04,869 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:04,869 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:04,870 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:04,874 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-04-09 15:55:04,874 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:04,874 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:04,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:04,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:04,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:04,875 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-04-09 15:55:04,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:04,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:04,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:55:04,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:04,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:04,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:55:04,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:04,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:04,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-04-09 15:55:04,877 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-04-09 15:55:04,877 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:04,877 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:04,877 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-04-09 15:55:04,877 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:04,879 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:55:04,879 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:55:04,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:55:04,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:55:04,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:55:04,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:04,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:04,879 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:04,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:04,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:04,880 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:04,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:04,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:55:04,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:55:04,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:04,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:55:04,881 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:04,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:04,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:04,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-04-09 15:55:04,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:04,883 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:04,883 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:55:04,883 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:04,883 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-04-09 15:55:04,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:04,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:04,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-04-09 15:55:04,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:04,883 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:04,883 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:04,884 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:55:04,884 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-04-09 15:55:04,884 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:04,884 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:04,883 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:04,884 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-04-09 15:55:04,884 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-04-09 15:55:04,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:04,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:04,984 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:04,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:04,986 DEBUG [Listener at localhost/39283] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:04,986 DEBUG [Listener at localhost/39283] regionserver.HStore(1912): 5edb26c74099296449ac252e8aa24185/family1 is initiating major compaction (all files) 2023-04-09 15:55:04,986 INFO [Listener at localhost/39283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:55:04,986 INFO [Listener at localhost/39283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:55:04,987 INFO [Listener at localhost/39283] regionserver.HRegion(2259): Starting compaction of 5edb26c74099296449ac252e8aa24185/family1 in testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:04,987 INFO [Listener at localhost/39283] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/631c4c55741a4999a4a87883f7cad6aa, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/46a363d96db148fa8e2a0428ef48e5de, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/27bfe4cf580941419fe1ee530dad30ed, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/ff23ebbd09f64cd09a309c5eacd98052, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/6a75675f3f88470d99cb623eb8b2a8ba] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp, totalSize=26.7 K 2023-04-09 15:55:04,988 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 631c4c55741a4999a4a87883f7cad6aa, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055695110 2023-04-09 15:55:04,988 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 46a363d96db148fa8e2a0428ef48e5de, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055696517 2023-04-09 15:55:04,989 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 27bfe4cf580941419fe1ee530dad30ed, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055697967 2023-04-09 15:55:04,989 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting ff23ebbd09f64cd09a309c5eacd98052, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055699430 2023-04-09 15:55:04,990 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 6a75675f3f88470d99cb623eb8b2a8ba, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-04-09 15:55:05,004 INFO [Listener at localhost/39283] throttle.PressureAwareThroughputController(145): 5edb26c74099296449ac252e8aa24185#family1#compaction#107 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:55:05,012 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230409706e7cac20a247f28a943895bacf0a90_del 2023-04-09 15:55:05,012 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409706e7cac20a247f28a943895bacf0a90_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409706e7cac20a247f28a943895bacf0a90_del 2023-04-09 15:55:05,426 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b4b5abc5c9524ac78bae3da61da3af2a 2023-04-09 15:55:05,427 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family1/b4b5abc5c9524ac78bae3da61da3af2a as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/b4b5abc5c9524ac78bae3da61da3af2a 2023-04-09 15:55:05,431 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b4b5abc5c9524ac78bae3da61da3af2a 2023-04-09 15:55:05,432 INFO [Listener at localhost/39283] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5edb26c74099296449ac252e8aa24185/family1 of 5edb26c74099296449ac252e8aa24185 into b4b5abc5c9524ac78bae3da61da3af2a(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:55:05,432 DEBUG [Listener at localhost/39283] regionserver.HRegion(2289): Compaction status journal for 5edb26c74099296449ac252e8aa24185: 2023-04-09 15:55:05,432 DEBUG [Listener at localhost/39283] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:05,432 DEBUG [Listener at localhost/39283] regionserver.HStore(1912): 5edb26c74099296449ac252e8aa24185/family2 is initiating major compaction (all files) 2023-04-09 15:55:05,432 INFO [Listener at localhost/39283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:55:05,433 INFO [Listener at localhost/39283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:55:05,433 INFO [Listener at localhost/39283] regionserver.HRegion(2259): Starting compaction of 5edb26c74099296449ac252e8aa24185/family2 in testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:05,433 INFO [Listener at localhost/39283] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/48c8a7dae6bf41859cf8faf76194adcf, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/7af52dc4dd584035a1cab3ea5e64325a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/72e08a32ca9a4e97840a12454ee021e6, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/9f6f733a0a1949c78db20b5e3437aba1, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/9fe9f91c916a4556a2ec31964ecf85c6] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp, totalSize=25.4 K 2023-04-09 15:55:05,433 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 48c8a7dae6bf41859cf8faf76194adcf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055695110 2023-04-09 15:55:05,433 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 7af52dc4dd584035a1cab3ea5e64325a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055696517 2023-04-09 15:55:05,434 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 72e08a32ca9a4e97840a12454ee021e6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055697967 2023-04-09 15:55:05,434 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 9f6f733a0a1949c78db20b5e3437aba1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055699430 2023-04-09 15:55:05,435 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 9fe9f91c916a4556a2ec31964ecf85c6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-04-09 15:55:05,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/631c4c55741a4999a4a87883f7cad6aa, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/46a363d96db148fa8e2a0428ef48e5de, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/27bfe4cf580941419fe1ee530dad30ed, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/ff23ebbd09f64cd09a309c5eacd98052, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/6a75675f3f88470d99cb623eb8b2a8ba] to archive 2023-04-09 15:55:05,448 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:05,451 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/631c4c55741a4999a4a87883f7cad6aa to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/631c4c55741a4999a4a87883f7cad6aa 2023-04-09 15:55:05,452 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/46a363d96db148fa8e2a0428ef48e5de to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/46a363d96db148fa8e2a0428ef48e5de 2023-04-09 15:55:05,453 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/27bfe4cf580941419fe1ee530dad30ed to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/27bfe4cf580941419fe1ee530dad30ed 2023-04-09 15:55:05,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/ff23ebbd09f64cd09a309c5eacd98052 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/ff23ebbd09f64cd09a309c5eacd98052 2023-04-09 15:55:05,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/6a75675f3f88470d99cb623eb8b2a8ba to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/6a75675f3f88470d99cb623eb8b2a8ba 2023-04-09 15:55:05,469 INFO [Listener at localhost/39283] throttle.PressureAwareThroughputController(145): 5edb26c74099296449ac252e8aa24185#family2#compaction#108 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:55:05,882 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230409947ca0abf20440e69d6b899648740007_del 2023-04-09 15:55:05,882 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409947ca0abf20440e69d6b899648740007_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230409947ca0abf20440e69d6b899648740007_del 2023-04-09 15:55:06,297 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0096e514f1154866b0bda9308389f0e8 2023-04-09 15:55:06,297 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family2/0096e514f1154866b0bda9308389f0e8 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/0096e514f1154866b0bda9308389f0e8 2023-04-09 15:55:06,301 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0096e514f1154866b0bda9308389f0e8 2023-04-09 15:55:06,302 INFO [Listener at localhost/39283] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5edb26c74099296449ac252e8aa24185/family2 of 5edb26c74099296449ac252e8aa24185 into 0096e514f1154866b0bda9308389f0e8(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:55:06,302 DEBUG [Listener at localhost/39283] regionserver.HRegion(2289): Compaction status journal for 5edb26c74099296449ac252e8aa24185: 2023-04-09 15:55:06,303 DEBUG [Listener at localhost/39283] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:06,303 DEBUG [Listener at localhost/39283] regionserver.HStore(1912): 0ae7083b5e65fccc3e4562ffb1cd8cdd/family1 is initiating major compaction (all files) 2023-04-09 15:55:06,303 INFO [Listener at localhost/39283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:55:06,303 INFO [Listener at localhost/39283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:55:06,304 INFO [Listener at localhost/39283] regionserver.HRegion(2259): Starting compaction of 0ae7083b5e65fccc3e4562ffb1cd8cdd/family1 in testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:06,304 INFO [Listener at localhost/39283] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/a9c534bcf81748ffa74639dbfd3e549f, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/cb9685cb74004119a43bc3a46ba07f3c, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/dbd4ed5695eb4e669873d652ee7ab056, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/822ee823e4704e678dc7b6d68699ab72, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/44934e434dcb4993a5f4bbb3c38199d1] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp, totalSize=26.7 K 2023-04-09 15:55:06,304 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting a9c534bcf81748ffa74639dbfd3e549f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055695107 2023-04-09 15:55:06,305 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting cb9685cb74004119a43bc3a46ba07f3c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055696517 2023-04-09 15:55:06,305 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting dbd4ed5695eb4e669873d652ee7ab056, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055697966 2023-04-09 15:55:06,306 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 822ee823e4704e678dc7b6d68699ab72, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055699430 2023-04-09 15:55:06,306 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 44934e434dcb4993a5f4bbb3c38199d1, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-04-09 15:55:06,318 INFO [Listener at localhost/39283] throttle.PressureAwareThroughputController(145): 0ae7083b5e65fccc3e4562ffb1cd8cdd#family1#compaction#109 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:55:06,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/48c8a7dae6bf41859cf8faf76194adcf, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/7af52dc4dd584035a1cab3ea5e64325a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/72e08a32ca9a4e97840a12454ee021e6, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/9f6f733a0a1949c78db20b5e3437aba1, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/9fe9f91c916a4556a2ec31964ecf85c6] to archive 2023-04-09 15:55:06,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:06,339 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/48c8a7dae6bf41859cf8faf76194adcf to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/48c8a7dae6bf41859cf8faf76194adcf 2023-04-09 15:55:06,341 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/7af52dc4dd584035a1cab3ea5e64325a to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/7af52dc4dd584035a1cab3ea5e64325a 2023-04-09 15:55:06,342 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/72e08a32ca9a4e97840a12454ee021e6 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/72e08a32ca9a4e97840a12454ee021e6 2023-04-09 15:55:06,343 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/9f6f733a0a1949c78db20b5e3437aba1 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/9f6f733a0a1949c78db20b5e3437aba1 2023-04-09 15:55:06,345 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/9fe9f91c916a4556a2ec31964ecf85c6 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/9fe9f91c916a4556a2ec31964ecf85c6 2023-04-09 15:55:06,735 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230409127e4393bd9a47c38c9d700747c6bc33_del 2023-04-09 15:55:06,735 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409127e4393bd9a47c38c9d700747c6bc33_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409127e4393bd9a47c38c9d700747c6bc33_del 2023-04-09 15:55:07,161 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6b8d0ec9c54e4daebf3ca8e9a4bd7a82 2023-04-09 15:55:07,164 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family1/6b8d0ec9c54e4daebf3ca8e9a4bd7a82 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/6b8d0ec9c54e4daebf3ca8e9a4bd7a82 2023-04-09 15:55:07,176 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6b8d0ec9c54e4daebf3ca8e9a4bd7a82 2023-04-09 15:55:07,177 INFO [Listener at localhost/39283] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0ae7083b5e65fccc3e4562ffb1cd8cdd/family1 of 0ae7083b5e65fccc3e4562ffb1cd8cdd into 6b8d0ec9c54e4daebf3ca8e9a4bd7a82(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:55:07,177 DEBUG [Listener at localhost/39283] regionserver.HRegion(2289): Compaction status journal for 0ae7083b5e65fccc3e4562ffb1cd8cdd: 2023-04-09 15:55:07,178 DEBUG [Listener at localhost/39283] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:07,178 DEBUG [Listener at localhost/39283] regionserver.HStore(1912): 0ae7083b5e65fccc3e4562ffb1cd8cdd/family2 is initiating major compaction (all files) 2023-04-09 15:55:07,178 INFO [Listener at localhost/39283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:55:07,178 INFO [Listener at localhost/39283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:55:07,178 INFO [Listener at localhost/39283] regionserver.HRegion(2259): Starting compaction of 0ae7083b5e65fccc3e4562ffb1cd8cdd/family2 in testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:07,178 INFO [Listener at localhost/39283] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/68c6f25961c94c86b3c801d041492736, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/6c675f47fcbe4664a2a107df6f673750, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/4147cd65e2a64a2abefea0a7610470a2, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/5da236d0b4594212b2891d90a7b41877, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/2e116b44ef734fc08daefcd87b14f954] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp, totalSize=25.4 K 2023-04-09 15:55:07,179 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 68c6f25961c94c86b3c801d041492736, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055695107 2023-04-09 15:55:07,179 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 6c675f47fcbe4664a2a107df6f673750, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055696517 2023-04-09 15:55:07,180 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 4147cd65e2a64a2abefea0a7610470a2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055697966 2023-04-09 15:55:07,180 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 5da236d0b4594212b2891d90a7b41877, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055699430 2023-04-09 15:55:07,181 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 2e116b44ef734fc08daefcd87b14f954, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-04-09 15:55:07,193 INFO [Listener at localhost/39283] throttle.PressureAwareThroughputController(145): 0ae7083b5e65fccc3e4562ffb1cd8cdd#family2#compaction#110 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:55:07,205 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230409f376e645b8a64c08b24199aacbc8e6b2_del 2023-04-09 15:55:07,205 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409f376e645b8a64c08b24199aacbc8e6b2_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409f376e645b8a64c08b24199aacbc8e6b2_del 2023-04-09 15:55:07,224 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c0a329f3f10a44198a3b7db2feefedc8 2023-04-09 15:55:07,225 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family2/c0a329f3f10a44198a3b7db2feefedc8 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/c0a329f3f10a44198a3b7db2feefedc8 2023-04-09 15:55:07,235 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c0a329f3f10a44198a3b7db2feefedc8 2023-04-09 15:55:07,237 INFO [Listener at localhost/39283] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0ae7083b5e65fccc3e4562ffb1cd8cdd/family2 of 0ae7083b5e65fccc3e4562ffb1cd8cdd into c0a329f3f10a44198a3b7db2feefedc8(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:55:07,237 DEBUG [Listener at localhost/39283] regionserver.HRegion(2289): Compaction status journal for 0ae7083b5e65fccc3e4562ffb1cd8cdd: 2023-04-09 15:55:07,237 DEBUG [Listener at localhost/39283] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:07,237 DEBUG [Listener at localhost/39283] regionserver.HStore(1912): 2720147230b846f05cd943c11531e895/family1 is initiating major compaction (all files) 2023-04-09 15:55:07,238 INFO [Listener at localhost/39283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:55:07,238 INFO [Listener at localhost/39283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:55:07,238 INFO [Listener at localhost/39283] regionserver.HRegion(2259): Starting compaction of 2720147230b846f05cd943c11531e895/family1 in testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:07,238 INFO [Listener at localhost/39283] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/4fabf06a69a84990b1fe22deb6848ae3, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/99243ed4dfad4f929375bf026305cf72, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/9fa1549e2a5f49faa4929250f248676b, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/ea11e2e967494f6ab6e9f3eb6ab26e68, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/261051335a334f91bcd3a39be5d3e690] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp, totalSize=26.7 K 2023-04-09 15:55:07,240 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/a9c534bcf81748ffa74639dbfd3e549f, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/cb9685cb74004119a43bc3a46ba07f3c, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/dbd4ed5695eb4e669873d652ee7ab056, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/822ee823e4704e678dc7b6d68699ab72, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/44934e434dcb4993a5f4bbb3c38199d1] to archive 2023-04-09 15:55:07,244 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 4fabf06a69a84990b1fe22deb6848ae3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055695109 2023-04-09 15:55:07,244 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:07,245 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 99243ed4dfad4f929375bf026305cf72, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055696517 2023-04-09 15:55:07,247 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 9fa1549e2a5f49faa4929250f248676b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055697967 2023-04-09 15:55:07,247 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/a9c534bcf81748ffa74639dbfd3e549f to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/a9c534bcf81748ffa74639dbfd3e549f 2023-04-09 15:55:07,247 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting ea11e2e967494f6ab6e9f3eb6ab26e68, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055699430 2023-04-09 15:55:07,248 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 261051335a334f91bcd3a39be5d3e690, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-04-09 15:55:07,249 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/cb9685cb74004119a43bc3a46ba07f3c to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/cb9685cb74004119a43bc3a46ba07f3c 2023-04-09 15:55:07,251 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/dbd4ed5695eb4e669873d652ee7ab056 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/dbd4ed5695eb4e669873d652ee7ab056 2023-04-09 15:55:07,253 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/822ee823e4704e678dc7b6d68699ab72 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/822ee823e4704e678dc7b6d68699ab72 2023-04-09 15:55:07,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/44934e434dcb4993a5f4bbb3c38199d1 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/44934e434dcb4993a5f4bbb3c38199d1 2023-04-09 15:55:07,257 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/68c6f25961c94c86b3c801d041492736, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/6c675f47fcbe4664a2a107df6f673750, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/4147cd65e2a64a2abefea0a7610470a2, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/5da236d0b4594212b2891d90a7b41877, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/2e116b44ef734fc08daefcd87b14f954] to archive 2023-04-09 15:55:07,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:07,259 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/68c6f25961c94c86b3c801d041492736 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/68c6f25961c94c86b3c801d041492736 2023-04-09 15:55:07,261 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/6c675f47fcbe4664a2a107df6f673750 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/6c675f47fcbe4664a2a107df6f673750 2023-04-09 15:55:07,263 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/4147cd65e2a64a2abefea0a7610470a2 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/4147cd65e2a64a2abefea0a7610470a2 2023-04-09 15:55:07,264 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/5da236d0b4594212b2891d90a7b41877 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/5da236d0b4594212b2891d90a7b41877 2023-04-09 15:55:07,267 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/2e116b44ef734fc08daefcd87b14f954 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/2e116b44ef734fc08daefcd87b14f954 2023-04-09 15:55:07,278 INFO [Listener at localhost/39283] throttle.PressureAwareThroughputController(145): 2720147230b846f05cd943c11531e895#family1#compaction#111 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:55:07,288 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202304097109fac548a44890af7ce2f06379ec5c_del 2023-04-09 15:55:07,288 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304097109fac548a44890af7ce2f06379ec5c_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304097109fac548a44890af7ce2f06379ec5c_del 2023-04-09 15:55:07,305 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f0afbbfdcc34f21b30e97586b93b9b3 2023-04-09 15:55:07,306 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family1/1f0afbbfdcc34f21b30e97586b93b9b3 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/1f0afbbfdcc34f21b30e97586b93b9b3 2023-04-09 15:55:07,309 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f0afbbfdcc34f21b30e97586b93b9b3 2023-04-09 15:55:07,310 INFO [Listener at localhost/39283] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2720147230b846f05cd943c11531e895/family1 of 2720147230b846f05cd943c11531e895 into 1f0afbbfdcc34f21b30e97586b93b9b3(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:55:07,310 DEBUG [Listener at localhost/39283] regionserver.HRegion(2289): Compaction status journal for 2720147230b846f05cd943c11531e895: 2023-04-09 15:55:07,310 DEBUG [Listener at localhost/39283] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:07,310 DEBUG [Listener at localhost/39283] regionserver.HStore(1912): 2720147230b846f05cd943c11531e895/family2 is initiating major compaction (all files) 2023-04-09 15:55:07,311 INFO [Listener at localhost/39283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:55:07,311 INFO [Listener at localhost/39283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:55:07,311 INFO [Listener at localhost/39283] regionserver.HRegion(2259): Starting compaction of 2720147230b846f05cd943c11531e895/family2 in testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:07,311 INFO [Listener at localhost/39283] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/6034a543e7964a0caf90eba11d97eb06, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/27ea281ccac2403283dcc700b50f015d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/45a8253ed7304a0997bd5d42d5fe6ecf, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8514d9964a5341a690c8eb6f47af97ba, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8a5d5d81e7a9489a92a6555d4e920755] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp, totalSize=25.4 K 2023-04-09 15:55:07,311 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 6034a543e7964a0caf90eba11d97eb06, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055695109 2023-04-09 15:55:07,312 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 27ea281ccac2403283dcc700b50f015d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055696517 2023-04-09 15:55:07,312 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 45a8253ed7304a0997bd5d42d5fe6ecf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055697967 2023-04-09 15:55:07,312 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 8514d9964a5341a690c8eb6f47af97ba, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055699430 2023-04-09 15:55:07,313 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 8a5d5d81e7a9489a92a6555d4e920755, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-04-09 15:55:07,333 INFO [Listener at localhost/39283] throttle.PressureAwareThroughputController(145): 2720147230b846f05cd943c11531e895#family2#compaction#112 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:55:07,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/4fabf06a69a84990b1fe22deb6848ae3, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/99243ed4dfad4f929375bf026305cf72, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/9fa1549e2a5f49faa4929250f248676b, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/ea11e2e967494f6ab6e9f3eb6ab26e68, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/261051335a334f91bcd3a39be5d3e690] to archive 2023-04-09 15:55:07,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:07,339 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/4fabf06a69a84990b1fe22deb6848ae3 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/4fabf06a69a84990b1fe22deb6848ae3 2023-04-09 15:55:07,340 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/99243ed4dfad4f929375bf026305cf72 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/99243ed4dfad4f929375bf026305cf72 2023-04-09 15:55:07,341 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/9fa1549e2a5f49faa4929250f248676b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/9fa1549e2a5f49faa4929250f248676b 2023-04-09 15:55:07,342 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/ea11e2e967494f6ab6e9f3eb6ab26e68 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/ea11e2e967494f6ab6e9f3eb6ab26e68 2023-04-09 15:55:07,343 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/261051335a334f91bcd3a39be5d3e690 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/261051335a334f91bcd3a39be5d3e690 2023-04-09 15:55:07,752 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023040907ec451c0b5e4dfda973fbd24c709ef6_del 2023-04-09 15:55:07,752 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023040907ec451c0b5e4dfda973fbd24c709ef6_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040907ec451c0b5e4dfda973fbd24c709ef6_del 2023-04-09 15:55:07,770 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c0b8153135349758190d45912ac9b42 2023-04-09 15:55:07,771 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family2/8c0b8153135349758190d45912ac9b42 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8c0b8153135349758190d45912ac9b42 2023-04-09 15:55:07,775 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c0b8153135349758190d45912ac9b42 2023-04-09 15:55:07,777 INFO [Listener at localhost/39283] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2720147230b846f05cd943c11531e895/family2 of 2720147230b846f05cd943c11531e895 into 8c0b8153135349758190d45912ac9b42(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:55:07,777 DEBUG [Listener at localhost/39283] regionserver.HRegion(2289): Compaction status journal for 2720147230b846f05cd943c11531e895: 2023-04-09 15:55:07,783 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:07,788 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:07,794 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:07,795 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:07,803 INFO [Listener at localhost/39283] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-04-09 15:55:07,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/6034a543e7964a0caf90eba11d97eb06, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/27ea281ccac2403283dcc700b50f015d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/45a8253ed7304a0997bd5d42d5fe6ecf, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8514d9964a5341a690c8eb6f47af97ba, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8a5d5d81e7a9489a92a6555d4e920755] to archive 2023-04-09 15:55:07,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:07,840 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/6034a543e7964a0caf90eba11d97eb06 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/6034a543e7964a0caf90eba11d97eb06 2023-04-09 15:55:07,842 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/27ea281ccac2403283dcc700b50f015d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/27ea281ccac2403283dcc700b50f015d 2023-04-09 15:55:07,844 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/45a8253ed7304a0997bd5d42d5fe6ecf to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/45a8253ed7304a0997bd5d42d5fe6ecf 2023-04-09 15:55:07,845 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8514d9964a5341a690c8eb6f47af97ba to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8514d9964a5341a690c8eb6f47af97ba 2023-04-09 15:55:07,847 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8a5d5d81e7a9489a92a6555d4e920755 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8a5d5d81e7a9489a92a6555d4e920755 2023-04-09 15:55:07,848 INFO [Listener at localhost/39283] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-04-09 15:55:07,852 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230409127e4393bd9a47c38c9d700747c6bc33_del 2023-04-09 15:55:07,860 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202304097109fac548a44890af7ce2f06379ec5c_del 2023-04-09 15:55:07,863 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230409706e7cac20a247f28a943895bacf0a90_del 2023-04-09 15:55:07,864 INFO [Listener at localhost/39283] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-04-09 15:55:07,864 DEBUG [Listener at localhost/39283] zookeeper.ReadOnlyZKClient(139): Connect 0x0ffb9150 to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:55:07,869 DEBUG [Listener at localhost/39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@664b55db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:55:07,869 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230409 for table='testCompactionWithHFileLink' and column='family1' 2023-04-09 15:55:07,872 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230409 for table='testCompactionWithHFileLink' and column='family1' 2023-04-09 15:55:07,879 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230409 for table='testCompactionWithHFileLink' and column='family1' 2023-04-09 15:55:08,757 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304093f119c0e3c4b402aa2a6d40479000c78 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304093f119c0e3c4b402aa2a6d40479000c78 2023-04-09 15:55:08,757 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230409 table='testCompactionWithHFileLink' column='family1' 2023-04-09 15:55:08,772 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:55:08,777 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:55:08,786 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-09 15:55:08,789 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-09 15:55:08,791 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409e94eb1d81e65483fbaf3619b681d655f to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409e94eb1d81e65483fbaf3619b681d655f 2023-04-09 15:55:08,792 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230409 table='testCompactionWithHFileLink' column='family1' 2023-04-09 15:55:08,801 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304091e845a1b9c4f41b5a1d2261e1c0cf877 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304091e845a1b9c4f41b5a1d2261e1c0cf877 2023-04-09 15:55:08,802 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230409 table='testCompactionWithHFileLink' column='family1' 2023-04-09 15:55:08,818 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230409/family1/010e1e1eed54468da9b87f258dfdee23 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-04-09 15:55:08,819 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230409/family1/010e1e1eed54468da9b87f258dfdee23}] 2023-04-09 15:55:08,825 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230409/family1/010e1e1eed54468da9b87f258dfdee23 for inclusion in 2720147230b846f05cd943c11531e895/family1 2023-04-09 15:55:08,831 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230409/family1/c46ac0170b1944f5afab8d0108b98a98 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-04-09 15:55:08,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-04-09 15:55:08,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first=1 last=2 2023-04-09 15:55:08,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for 2720147230b846f05cd943c11531e895: 2023-04-09 15:55:08,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230409/family1/010e1e1eed54468da9b87f258dfdee23 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__2pnnh3do3ff0g3n1d5l4b895q56u3a41mjomplssublbs30fsgv9tpvetm90m2b8/family1/010e1e1eed54468da9b87f258dfdee23 2023-04-09 15:55:08,834 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230409/family1/c46ac0170b1944f5afab8d0108b98a98}] 2023-04-09 15:55:08,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230409/family1/c46ac0170b1944f5afab8d0108b98a98 for inclusion in 0ae7083b5e65fccc3e4562ffb1cd8cdd/family1 2023-04-09 15:55:08,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__2pnnh3do3ff0g3n1d5l4b895q56u3a41mjomplssublbs30fsgv9tpvetm90m2b8/family1/010e1e1eed54468da9b87f258dfdee23 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/227e5c622a8c41319ee1649ec3a5635a_SeqId_29_ 2023-04-09 15:55:08,839 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__2pnnh3do3ff0g3n1d5l4b895q56u3a41mjomplssublbs30fsgv9tpvetm90m2b8/family1/010e1e1eed54468da9b87f258dfdee23 into 2720147230b846f05cd943c11531e895/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/227e5c622a8c41319ee1649ec3a5635a_SeqId_29_ - updating store file list. 2023-04-09 15:55:08,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-04-09 15:55:08,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last=1 2023-04-09 15:55:08,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for 0ae7083b5e65fccc3e4562ffb1cd8cdd: 2023-04-09 15:55:08,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230409/family1/c46ac0170b1944f5afab8d0108b98a98 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__e3j6bm5mel9k9rei2qlvcc0r8qthoi9s0eklg2ibsh9hgvjiuatglr09mrshdoa0/family1/c46ac0170b1944f5afab8d0108b98a98 2023-04-09 15:55:08,843 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230409/family1/d636d9ba4b754546aebdfec48721f07c first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-04-09 15:55:08,844 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/227e5c622a8c41319ee1649ec3a5635a_SeqId_29_ into 2720147230b846f05cd943c11531e895/family1 2023-04-09 15:55:08,844 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230409/family1/d636d9ba4b754546aebdfec48721f07c}] 2023-04-09 15:55:08,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__e3j6bm5mel9k9rei2qlvcc0r8qthoi9s0eklg2ibsh9hgvjiuatglr09mrshdoa0/family1/c46ac0170b1944f5afab8d0108b98a98 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/ec44da3d6f0744108e18d518029cb9f7_SeqId_29_ 2023-04-09 15:55:08,844 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__2pnnh3do3ff0g3n1d5l4b895q56u3a41mjomplssublbs30fsgv9tpvetm90m2b8/family1/010e1e1eed54468da9b87f258dfdee23 into 2720147230b846f05cd943c11531e895/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/227e5c622a8c41319ee1649ec3a5635a_SeqId_29_) 2023-04-09 15:55:08,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__e3j6bm5mel9k9rei2qlvcc0r8qthoi9s0eklg2ibsh9hgvjiuatglr09mrshdoa0/family1/c46ac0170b1944f5afab8d0108b98a98 into 0ae7083b5e65fccc3e4562ffb1cd8cdd/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/ec44da3d6f0744108e18d518029cb9f7_SeqId_29_ - updating store file list. 2023-04-09 15:55:08,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__2pnnh3do3ff0g3n1d5l4b895q56u3a41mjomplssublbs30fsgv9tpvetm90m2b8/family1/010e1e1eed54468da9b87f258dfdee23 2023-04-09 15:55:08,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/ec44da3d6f0744108e18d518029cb9f7_SeqId_29_ into 0ae7083b5e65fccc3e4562ffb1cd8cdd/family1 2023-04-09 15:55:08,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__e3j6bm5mel9k9rei2qlvcc0r8qthoi9s0eklg2ibsh9hgvjiuatglr09mrshdoa0/family1/c46ac0170b1944f5afab8d0108b98a98 into 0ae7083b5e65fccc3e4562ffb1cd8cdd/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/ec44da3d6f0744108e18d518029cb9f7_SeqId_29_) 2023-04-09 15:55:08,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__e3j6bm5mel9k9rei2qlvcc0r8qthoi9s0eklg2ibsh9hgvjiuatglr09mrshdoa0/family1/c46ac0170b1944f5afab8d0108b98a98 2023-04-09 15:55:08,849 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230409 table='testCompactionWithHFileLink' column='family1' 2023-04-09 15:55:08,849 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230409/family1/d636d9ba4b754546aebdfec48721f07c for inclusion in 5edb26c74099296449ac252e8aa24185/family1 2023-04-09 15:55:08,850 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:08,851 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230409 table='testCompactionWithHFileLink' column='family1' 2023-04-09 15:55:08,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-04-09 15:55:08,851 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:08,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first=2 last= 2023-04-09 15:55:08,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for 5edb26c74099296449ac252e8aa24185: 2023-04-09 15:55:08,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230409/family1/d636d9ba4b754546aebdfec48721f07c to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__qhpf1i295hombmd8blftei79mclcqg164rpqfg8bvu7cbbrtgq6090voren4ruk0/family1/d636d9ba4b754546aebdfec48721f07c 2023-04-09 15:55:08,852 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023040931ad9321e8674aa8991061368bf3b1d4 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023040931ad9321e8674aa8991061368bf3b1d4 2023-04-09 15:55:08,853 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023040908d0dfb685444d24bf8e997250823d01 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023040908d0dfb685444d24bf8e997250823d01 2023-04-09 15:55:08,854 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230409544d36343520473a9a86321189e90cf9 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230409544d36343520473a9a86321189e90cf9 2023-04-09 15:55:08,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__qhpf1i295hombmd8blftei79mclcqg164rpqfg8bvu7cbbrtgq6090voren4ruk0/family1/d636d9ba4b754546aebdfec48721f07c as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/515eb8e0216c4569ae5f415ec94d8364_SeqId_29_ 2023-04-09 15:55:08,855 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409525e35a922af42e7bf71c42be5460e73 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409525e35a922af42e7bf71c42be5460e73 2023-04-09 15:55:08,855 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__qhpf1i295hombmd8blftei79mclcqg164rpqfg8bvu7cbbrtgq6090voren4ruk0/family1/d636d9ba4b754546aebdfec48721f07c into 5edb26c74099296449ac252e8aa24185/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/515eb8e0216c4569ae5f415ec94d8364_SeqId_29_ - updating store file list. 2023-04-09 15:55:08,855 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304095976a4b334664952a003191ed0db432e to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304095976a4b334664952a003191ed0db432e 2023-04-09 15:55:08,857 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409d3db5ee0905a4d67b84c282558c90c9f to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409d3db5ee0905a4d67b84c282558c90c9f 2023-04-09 15:55:08,857 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304098be8de8eb1514b8cbadbc106cd83b365 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304098be8de8eb1514b8cbadbc106cd83b365 2023-04-09 15:55:08,857 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-04-09 15:55:08,857 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230409' 2023-04-09 15:55:08,858 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230409 for table='testCompactionWithHFileLink' and column='family1' 2023-04-09 15:55:08,858 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409ea6b65a7d4ba48299de583656fe52652 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409ea6b65a7d4ba48299de583656fe52652 2023-04-09 15:55:08,858 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-04-09 15:55:08,858 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230409' 2023-04-09 15:55:08,858 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230409 for table='testCompactionWithHFileLink' and column='family1' 2023-04-09 15:55:08,859 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/515eb8e0216c4569ae5f415ec94d8364_SeqId_29_ into 5edb26c74099296449ac252e8aa24185/family1 2023-04-09 15:55:08,859 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__qhpf1i295hombmd8blftei79mclcqg164rpqfg8bvu7cbbrtgq6090voren4ruk0/family1/d636d9ba4b754546aebdfec48721f07c into 5edb26c74099296449ac252e8aa24185/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/515eb8e0216c4569ae5f415ec94d8364_SeqId_29_) 2023-04-09 15:55:08,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__qhpf1i295hombmd8blftei79mclcqg164rpqfg8bvu7cbbrtgq6090voren4ruk0/family1/d636d9ba4b754546aebdfec48721f07c 2023-04-09 15:55:08,861 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230409 table='testCompactionWithHFileLink' column='family1' 2023-04-09 15:55:08,862 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:08,863 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023040938d91309f2d645ceae048ace07c171fb to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023040938d91309f2d645ceae048ace07c171fb 2023-04-09 15:55:08,864 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409a029596bc9cc4e35be5c80b0dd75d03b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409a029596bc9cc4e35be5c80b0dd75d03b 2023-04-09 15:55:08,865 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409e5f4bd2fe7b34bc1a6bfb070651d0ecd to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409e5f4bd2fe7b34bc1a6bfb070651d0ecd 2023-04-09 15:55:08,866 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409f0eec9b8918e4ede924f48521003bc95 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409f0eec9b8918e4ede924f48521003bc95 2023-04-09 15:55:08,866 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-04-09 15:55:08,866 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230409' 2023-04-09 15:55:08,867 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230409 for table='testCompactionWithHFileLink' and column='family1' 2023-04-09 15:55:08,867 INFO [Listener at localhost/39283] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-04-09 15:55:08,867 INFO [Listener at localhost/39283] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-04-09 15:55:08,867 INFO [Listener at localhost/39283] compactions.PartitionedMobCompactor(367): [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409127e4393bd9a47c38c9d700747c6bc33_del] 2023-04-09 15:55:08,868 DEBUG [Listener at localhost/39283] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:08,869 DEBUG [Listener at localhost/39283] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409127e4393bd9a47c38c9d700747c6bc33_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409127e4393bd9a47c38c9d700747c6bc33_del 2023-04-09 15:55:08,869 INFO [Listener at localhost/39283] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-04-09 15:55:08,869 INFO [Listener at localhost/39283] compactions.PartitionedMobCompactor(367): [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304097109fac548a44890af7ce2f06379ec5c_del] 2023-04-09 15:55:08,869 DEBUG [Listener at localhost/39283] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:08,871 DEBUG [Listener at localhost/39283] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304097109fac548a44890af7ce2f06379ec5c_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304097109fac548a44890af7ce2f06379ec5c_del 2023-04-09 15:55:08,871 INFO [Listener at localhost/39283] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-04-09 15:55:08,871 INFO [Listener at localhost/39283] compactions.PartitionedMobCompactor(367): [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409706e7cac20a247f28a943895bacf0a90_del] 2023-04-09 15:55:08,871 DEBUG [Listener at localhost/39283] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:08,873 DEBUG [Listener at localhost/39283] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409706e7cac20a247f28a943895bacf0a90_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409706e7cac20a247f28a943895bacf0a90_del 2023-04-09 15:55:08,873 INFO [Listener at localhost/39283] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-04-09 15:55:08,876 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:08,878 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:08,881 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:08,882 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:08,889 INFO [Listener at localhost/39283] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-04-09 15:55:08,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-04-09 15:55:08,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-04-09 15:55:08,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-04-09 15:55:08,893 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055708893"}]},"ts":"1681055708893"} 2023-04-09 15:55:08,894 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-04-09 15:55:08,896 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-04-09 15:55:08,897 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ae7083b5e65fccc3e4562ffb1cd8cdd, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2720147230b846f05cd943c11531e895, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5edb26c74099296449ac252e8aa24185, UNASSIGN}] 2023-04-09 15:55:08,898 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2720147230b846f05cd943c11531e895, UNASSIGN 2023-04-09 15:55:08,898 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ae7083b5e65fccc3e4562ffb1cd8cdd, UNASSIGN 2023-04-09 15:55:08,898 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5edb26c74099296449ac252e8aa24185, UNASSIGN 2023-04-09 15:55:08,899 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=2720147230b846f05cd943c11531e895, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:08,899 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1681055708899"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055708899"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055708899"}]},"ts":"1681055708899"} 2023-04-09 15:55:08,899 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=0ae7083b5e65fccc3e4562ffb1cd8cdd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:08,899 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=5edb26c74099296449ac252e8aa24185, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:08,899 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1681055708899"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055708899"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055708899"}]},"ts":"1681055708899"} 2023-04-09 15:55:08,900 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1681055708899"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055708899"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055708899"}]},"ts":"1681055708899"} 2023-04-09 15:55:08,900 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 2720147230b846f05cd943c11531e895, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:55:08,901 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 0ae7083b5e65fccc3e4562ffb1cd8cdd, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:55:08,901 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure 5edb26c74099296449ac252e8aa24185, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:55:08,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-04-09 15:55:09,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2720147230b846f05cd943c11531e895 2023-04-09 15:55:09,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2720147230b846f05cd943c11531e895, disabling compactions & flushes 2023-04-09 15:55:09,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:09,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:09,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. after waiting 0 ms 2023-04-09 15:55:09,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:09,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-04-09 15:55:09,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:09,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2720147230b846f05cd943c11531e895: 2023-04-09 15:55:09,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2720147230b846f05cd943c11531e895 2023-04-09 15:55:09,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:55:09,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0ae7083b5e65fccc3e4562ffb1cd8cdd, disabling compactions & flushes 2023-04-09 15:55:09,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:09,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:09,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. after waiting 0 ms 2023-04-09 15:55:09,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:09,062 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=2720147230b846f05cd943c11531e895, regionState=CLOSED 2023-04-09 15:55:09,062 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1681055709062"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055709062"}]},"ts":"1681055709062"} 2023-04-09 15:55:09,065 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-04-09 15:55:09,065 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure 2720147230b846f05cd943c11531e895, server=jenkins-hbase4.apache.org,44869,1681055618167 in 163 msec 2023-04-09 15:55:09,066 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2720147230b846f05cd943c11531e895, UNASSIGN in 168 msec 2023-04-09 15:55:09,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-04-09 15:55:09,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:09,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0ae7083b5e65fccc3e4562ffb1cd8cdd: 2023-04-09 15:55:09,070 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=0ae7083b5e65fccc3e4562ffb1cd8cdd, regionState=CLOSED 2023-04-09 15:55:09,070 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1681055709069"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055709069"}]},"ts":"1681055709069"} 2023-04-09 15:55:09,072 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=89 2023-04-09 15:55:09,072 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure 0ae7083b5e65fccc3e4562ffb1cd8cdd, server=jenkins-hbase4.apache.org,44869,1681055618167 in 170 msec 2023-04-09 15:55:09,073 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ae7083b5e65fccc3e4562ffb1cd8cdd, UNASSIGN in 175 msec 2023-04-09 15:55:09,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:55:09,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5edb26c74099296449ac252e8aa24185 2023-04-09 15:55:09,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5edb26c74099296449ac252e8aa24185, disabling compactions & flushes 2023-04-09 15:55:09,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:09,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:09,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. after waiting 0 ms 2023-04-09 15:55:09,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:09,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-04-09 15:55:09,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:09,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5edb26c74099296449ac252e8aa24185: 2023-04-09 15:55:09,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5edb26c74099296449ac252e8aa24185 2023-04-09 15:55:09,082 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=5edb26c74099296449ac252e8aa24185, regionState=CLOSED 2023-04-09 15:55:09,083 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1681055709082"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055709082"}]},"ts":"1681055709082"} 2023-04-09 15:55:09,085 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-04-09 15:55:09,085 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure 5edb26c74099296449ac252e8aa24185, server=jenkins-hbase4.apache.org,44869,1681055618167 in 183 msec 2023-04-09 15:55:09,087 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=88 2023-04-09 15:55:09,087 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5edb26c74099296449ac252e8aa24185, UNASSIGN in 188 msec 2023-04-09 15:55:09,087 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055709087"}]},"ts":"1681055709087"} 2023-04-09 15:55:09,088 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-04-09 15:55:09,090 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-04-09 15:55:09,092 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 200 msec 2023-04-09 15:55:09,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-04-09 15:55:09,195 INFO [Listener at localhost/39283] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-04-09 15:55:09,208 INFO [Listener at localhost/39283] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1681055700900-1681055709207 2023-04-09 15:55:09,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1681055700900-1681055709207 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-04-09 15:55:09,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1681055709208 (current time:1681055709208). 2023-04-09 15:55:09,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-04-09 15:55:09,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] zookeeper.ReadOnlyZKClient(139): Connect 0x03c23288 to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:55:09,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70b6e01e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:55:09,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:55:09,217 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43588, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:55:09,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03c23288 to 127.0.0.1:64813 2023-04-09 15:55:09,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:55:09,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-04-09 15:55:09,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1681055700900-1681055709207 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-04-09 15:55:09,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-04-09 15:55:09,221 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-04-09 15:55:09,221 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1681056309221 2023-04-09 15:55:09,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1681055700900-1681055709207 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-04-09 15:55:09,221 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1681055700900-1681055709207 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-04-09 15:55:09,222 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1681055700900-1681055709207 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:09,222 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-04-09 15:55:09,322 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-09 15:55:09,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1681055700900-1681055709207 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-09 15:55:09,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1681055700900-1681055709207 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-04-09 15:55:09,323 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-04-09 15:55:09,523 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-09 15:55:09,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1681055700900-1681055709207 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-09 15:55:09,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1681055700900-1681055709207 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-04-09 15:55:09,525 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-04-09 15:55:09,643 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1681055700900-1681055709207 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-04-09 15:55:09,644 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-04-09 15:55:09,645 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-04-09 15:55:09,645 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-04-09 15:55:09,645 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-04-09 15:55:09,645 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-04-09 15:55:09,645 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-04-09 15:55:09,645 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-04-09 15:55:09,645 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-04-09 15:55:09,649 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/1f0afbbfdcc34f21b30e97586b93b9b3, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/227e5c622a8c41319ee1649ec3a5635a_SeqId_29_] hfiles 2023-04-09 15:55:09,649 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/1f0afbbfdcc34f21b30e97586b93b9b3 2023-04-09 15:55:09,649 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/227e5c622a8c41319ee1649ec3a5635a_SeqId_29_ 2023-04-09 15:55:09,649 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/6b8d0ec9c54e4daebf3ca8e9a4bd7a82, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/ec44da3d6f0744108e18d518029cb9f7_SeqId_29_] hfiles 2023-04-09 15:55:09,649 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304093f119c0e3c4b402aa2a6d40479000c78, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304091e845a1b9c4f41b5a1d2261e1c0cf877, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409e94eb1d81e65483fbaf3619b681d655f] hfiles 2023-04-09 15:55:09,649 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304093f119c0e3c4b402aa2a6d40479000c78 2023-04-09 15:55:09,649 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304091e845a1b9c4f41b5a1d2261e1c0cf877 2023-04-09 15:55:09,649 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409e94eb1d81e65483fbaf3619b681d655f 2023-04-09 15:55:09,649 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/6b8d0ec9c54e4daebf3ca8e9a4bd7a82 2023-04-09 15:55:09,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/515eb8e0216c4569ae5f415ec94d8364_SeqId_29_, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/b4b5abc5c9524ac78bae3da61da3af2a] hfiles 2023-04-09 15:55:09,650 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/ec44da3d6f0744108e18d518029cb9f7_SeqId_29_ 2023-04-09 15:55:09,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/515eb8e0216c4569ae5f415ec94d8364_SeqId_29_ 2023-04-09 15:55:09,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/b4b5abc5c9524ac78bae3da61da3af2a 2023-04-09 15:55:09,650 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8c0b8153135349758190d45912ac9b42] hfiles 2023-04-09 15:55:09,650 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8c0b8153135349758190d45912ac9b42 2023-04-09 15:55:09,651 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/c0a329f3f10a44198a3b7db2feefedc8] hfiles 2023-04-09 15:55:09,651 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/c0a329f3f10a44198a3b7db2feefedc8 2023-04-09 15:55:09,651 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/0096e514f1154866b0bda9308389f0e8] hfiles 2023-04-09 15:55:09,651 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/0096e514f1154866b0bda9308389f0e8 2023-04-09 15:55:09,658 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040907ec451c0b5e4dfda973fbd24c709ef6_del, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202304092b4f598569ba48068ad2239ed724e90d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230409434a4cd1e64a41479e8b9c5774fa14b3, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040945d19a1d67cd49039b65a39b72ea18fb, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040985a9118f4dd5412385de39a64fafaab5, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202304091936b9f2f7c24634b5e00457cf56c263, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023040930aa45d7b8e24900b09a79ae930ab814, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230409830a944cf3ad49e5b01ef8ffa67bdccb, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230409947ca0abf20440e69d6b899648740007_del, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230409e22e2f086b4b4d28a8376e3473963289, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409003d005d27df4c009520f850d2f6dffa, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409163ef4ed67e94e0789fdb43264487fa2, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202304094d8bc058805f43e0819c7793cbfba51f, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409b41482bc0d454cf48286ad4087e61dbf, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409f376e645b8a64c08b24199aacbc8e6b2_del] hfiles 2023-04-09 15:55:09,658 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040907ec451c0b5e4dfda973fbd24c709ef6_del 2023-04-09 15:55:09,658 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202304092b4f598569ba48068ad2239ed724e90d 2023-04-09 15:55:09,658 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230409434a4cd1e64a41479e8b9c5774fa14b3 2023-04-09 15:55:09,658 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040945d19a1d67cd49039b65a39b72ea18fb 2023-04-09 15:55:09,658 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040985a9118f4dd5412385de39a64fafaab5 2023-04-09 15:55:09,658 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202304091936b9f2f7c24634b5e00457cf56c263 2023-04-09 15:55:09,658 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023040930aa45d7b8e24900b09a79ae930ab814 2023-04-09 15:55:09,659 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230409830a944cf3ad49e5b01ef8ffa67bdccb 2023-04-09 15:55:09,659 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230409947ca0abf20440e69d6b899648740007_del 2023-04-09 15:55:09,659 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230409e22e2f086b4b4d28a8376e3473963289 2023-04-09 15:55:09,659 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409003d005d27df4c009520f850d2f6dffa 2023-04-09 15:55:09,659 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409163ef4ed67e94e0789fdb43264487fa2 2023-04-09 15:55:09,659 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202304094d8bc058805f43e0819c7793cbfba51f 2023-04-09 15:55:09,659 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409b41482bc0d454cf48286ad4087e61dbf 2023-04-09 15:55:09,659 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409f376e645b8a64c08b24199aacbc8e6b2_del 2023-04-09 15:55:09,825 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-09 15:55:09,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1681055700900-1681055709207 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-09 15:55:09,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1681055700900-1681055709207 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-04-09 15:55:09,826 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-04-09 15:55:10,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1681055700900-1681055709207 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-04-09 15:55:10,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1681055700900-1681055709207 2023-04-09 15:55:10,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1681055700900-1681055709207 2023-04-09 15:55:10,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1681055700900-1681055709207 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.hbase-snapshot/hbase-failsafe-snaptb-1681055700900-1681055709207 2023-04-09 15:55:10,327 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-09 15:55:10,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1681055700900-1681055709207 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-09 15:55:10,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1681055700900-1681055709207 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-04-09 15:55:10,328 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-04-09 15:55:10,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1681055700900-1681055709207 of table testCompactionWithHFileLink completed 2023-04-09 15:55:10,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1681055700900-1681055709207 2023-04-09 15:55:10,926 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1681055700900-1681055709207 2023-04-09 15:55:10,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1681055700900-1681055709207 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1681055709222Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1681055700900-1681055709207 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1681055709643 (+421 ms)Consolidate snapshot: hbase-failsafe-snaptb-1681055700900-1681055709207 at 1681055710066 (+423 ms)Loading Region manifests for hbase-failsafe-snaptb-1681055700900-1681055709207 at 1681055710066Writing data manifest for hbase-failsafe-snaptb-1681055700900-1681055709207 at 1681055710077 (+11 ms)Verifying snapshot: hbase-failsafe-snaptb-1681055700900-1681055709207 at 1681055710087 (+10 ms)Snapshot hbase-failsafe-snaptb-1681055700900-1681055709207 of table testCompactionWithHFileLink completed at 1681055710926 (+839 ms) 2023-04-09 15:55:10,927 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-04-09 15:55:10,929 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.7080 sec 2023-04-09 15:55:11,328 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-04-09 15:55:11,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1681055700900-1681055709207 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-04-09 15:55:11,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1681055700900-1681055709207 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-04-09 15:55:11,569 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-09 15:55:11,570 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-04-09 15:55:11,571 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ffb9150 to 127.0.0.1:64813 2023-04-09 15:55:11,571 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:55:11,571 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-09 15:55:11,571 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e3d1fe8 to 127.0.0.1:64813 2023-04-09 15:55:11,571 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:55:11,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1681055700900" table: "testCompactionWithHFileLink" creation_time: 1681055700912 type: FLUSH version: 2 ttl: 0 ) 2023-04-09 15:55:11,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1681055700900 as table=testCompactionWithHFileLink 2023-04-09 15:55:11,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-04-09 15:55:11,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-04-09 15:55:11,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-04-09 15:55:11,994 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-04-09 15:55:11,995 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-04-09 15:55:11,995 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-04-09 15:55:11,996 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1681055700900 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-04-09 15:55:12,002 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1681055700900" table: "testCompactionWithHFileLink" creation_time: 1681055700912 type: FLUSH version: 2 ttl: 0 2023-04-09 15:55:12,003 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink 2023-04-09 15:55:12,008 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-04-09 15:55:12,012 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304093f119c0e3c4b402aa2a6d40479000c78 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202304093f119c0e3c4b402aa2a6d40479000c78 2023-04-09 15:55:12,013 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409e94eb1d81e65483fbaf3619b681d655f to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409e94eb1d81e65483fbaf3619b681d655f 2023-04-09 15:55:12,015 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304091e845a1b9c4f41b5a1d2261e1c0cf877 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202304091e845a1b9c4f41b5a1d2261e1c0cf877 2023-04-09 15:55:12,015 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023040931ad9321e8674aa8991061368bf3b1d4 of snapshot=snaptb-1681055700900 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-09 15:55:12,018 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230409544d36343520473a9a86321189e90cf9 of snapshot=snaptb-1681055700900 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-09 15:55:12,021 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202304095976a4b334664952a003191ed0db432e of snapshot=snaptb-1681055700900 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-09 15:55:12,025 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202304098be8de8eb1514b8cbadbc106cd83b365 of snapshot=snaptb-1681055700900 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-09 15:55:12,028 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023040938d91309f2d645ceae048ace07c171fb of snapshot=snaptb-1681055700900 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-09 15:55:12,036 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230409a029596bc9cc4e35be5c80b0dd75d03b of snapshot=snaptb-1681055700900 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-09 15:55:12,039 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230409e5f4bd2fe7b34bc1a6bfb070651d0ecd of snapshot=snaptb-1681055700900 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-09 15:55:12,042 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230409f0eec9b8918e4ede924f48521003bc95 of snapshot=snaptb-1681055700900 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-09 15:55:12,046 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023040908d0dfb685444d24bf8e997250823d01 of snapshot=snaptb-1681055700900 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-09 15:55:12,050 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230409525e35a922af42e7bf71c42be5460e73 of snapshot=snaptb-1681055700900 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-09 15:55:12,053 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230409d3db5ee0905a4d67b84c282558c90c9f of snapshot=snaptb-1681055700900 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-09 15:55:12,058 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230409ea6b65a7d4ba48299de583656fe52652 of snapshot=snaptb-1681055700900 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-04-09 15:55:12,063 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040907ec451c0b5e4dfda973fbd24c709ef6_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023040907ec451c0b5e4dfda973fbd24c709ef6_del 2023-04-09 15:55:12,065 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230409947ca0abf20440e69d6b899648740007_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230409947ca0abf20440e69d6b899648740007_del 2023-04-09 15:55:12,066 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409f376e645b8a64c08b24199aacbc8e6b2_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230409f376e645b8a64c08b24199aacbc8e6b2_del 2023-04-09 15:55:12,066 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:55:12,066 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 2720147230b846f05cd943c11531e895 2023-04-09 15:55:12,066 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 5edb26c74099296449ac252e8aa24185 2023-04-09 15:55:12,071 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/6b8d0ec9c54e4daebf3ca8e9a4bd7a82 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/6b8d0ec9c54e4daebf3ca8e9a4bd7a82 2023-04-09 15:55:12,071 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/515eb8e0216c4569ae5f415ec94d8364_SeqId_29_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/515eb8e0216c4569ae5f415ec94d8364_SeqId_29_ 2023-04-09 15:55:12,072 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/227e5c622a8c41319ee1649ec3a5635a_SeqId_29_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/227e5c622a8c41319ee1649ec3a5635a_SeqId_29_ 2023-04-09 15:55:12,073 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/ec44da3d6f0744108e18d518029cb9f7_SeqId_29_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/ec44da3d6f0744108e18d518029cb9f7_SeqId_29_ 2023-04-09 15:55:12,073 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a9c534bcf81748ffa74639dbfd3e549f of snapshot=snaptb-1681055700900 to region=0ae7083b5e65fccc3e4562ffb1cd8cdd table=testCompactionWithHFileLink 2023-04-09 15:55:12,073 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/b4b5abc5c9524ac78bae3da61da3af2a to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/b4b5abc5c9524ac78bae3da61da3af2a 2023-04-09 15:55:12,073 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 631c4c55741a4999a4a87883f7cad6aa of snapshot=snaptb-1681055700900 to region=5edb26c74099296449ac252e8aa24185 table=testCompactionWithHFileLink 2023-04-09 15:55:12,074 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/1f0afbbfdcc34f21b30e97586b93b9b3 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/1f0afbbfdcc34f21b30e97586b93b9b3 2023-04-09 15:55:12,074 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4fabf06a69a84990b1fe22deb6848ae3 of snapshot=snaptb-1681055700900 to region=2720147230b846f05cd943c11531e895 table=testCompactionWithHFileLink 2023-04-09 15:55:12,085 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cb9685cb74004119a43bc3a46ba07f3c of snapshot=snaptb-1681055700900 to region=0ae7083b5e65fccc3e4562ffb1cd8cdd table=testCompactionWithHFileLink 2023-04-09 15:55:12,085 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 46a363d96db148fa8e2a0428ef48e5de of snapshot=snaptb-1681055700900 to region=5edb26c74099296449ac252e8aa24185 table=testCompactionWithHFileLink 2023-04-09 15:55:12,086 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 99243ed4dfad4f929375bf026305cf72 of snapshot=snaptb-1681055700900 to region=2720147230b846f05cd943c11531e895 table=testCompactionWithHFileLink 2023-04-09 15:55:12,090 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 27bfe4cf580941419fe1ee530dad30ed of snapshot=snaptb-1681055700900 to region=5edb26c74099296449ac252e8aa24185 table=testCompactionWithHFileLink 2023-04-09 15:55:12,090 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink dbd4ed5695eb4e669873d652ee7ab056 of snapshot=snaptb-1681055700900 to region=0ae7083b5e65fccc3e4562ffb1cd8cdd table=testCompactionWithHFileLink 2023-04-09 15:55:12,091 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9fa1549e2a5f49faa4929250f248676b of snapshot=snaptb-1681055700900 to region=2720147230b846f05cd943c11531e895 table=testCompactionWithHFileLink 2023-04-09 15:55:12,096 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ff23ebbd09f64cd09a309c5eacd98052 of snapshot=snaptb-1681055700900 to region=5edb26c74099296449ac252e8aa24185 table=testCompactionWithHFileLink 2023-04-09 15:55:12,097 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 822ee823e4704e678dc7b6d68699ab72 of snapshot=snaptb-1681055700900 to region=0ae7083b5e65fccc3e4562ffb1cd8cdd table=testCompactionWithHFileLink 2023-04-09 15:55:12,098 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ea11e2e967494f6ab6e9f3eb6ab26e68 of snapshot=snaptb-1681055700900 to region=2720147230b846f05cd943c11531e895 table=testCompactionWithHFileLink 2023-04-09 15:55:12,107 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/c0a329f3f10a44198a3b7db2feefedc8 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/c0a329f3f10a44198a3b7db2feefedc8 2023-04-09 15:55:12,107 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 68c6f25961c94c86b3c801d041492736 of snapshot=snaptb-1681055700900 to region=0ae7083b5e65fccc3e4562ffb1cd8cdd table=testCompactionWithHFileLink 2023-04-09 15:55:12,108 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8c0b8153135349758190d45912ac9b42 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/8c0b8153135349758190d45912ac9b42 2023-04-09 15:55:12,108 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6034a543e7964a0caf90eba11d97eb06 of snapshot=snaptb-1681055700900 to region=2720147230b846f05cd943c11531e895 table=testCompactionWithHFileLink 2023-04-09 15:55:12,133 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 27ea281ccac2403283dcc700b50f015d of snapshot=snaptb-1681055700900 to region=2720147230b846f05cd943c11531e895 table=testCompactionWithHFileLink 2023-04-09 15:55:12,134 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6c675f47fcbe4664a2a107df6f673750 of snapshot=snaptb-1681055700900 to region=0ae7083b5e65fccc3e4562ffb1cd8cdd table=testCompactionWithHFileLink 2023-04-09 15:55:12,134 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/0096e514f1154866b0bda9308389f0e8 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/0096e514f1154866b0bda9308389f0e8 2023-04-09 15:55:12,134 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 48c8a7dae6bf41859cf8faf76194adcf of snapshot=snaptb-1681055700900 to region=5edb26c74099296449ac252e8aa24185 table=testCompactionWithHFileLink 2023-04-09 15:55:12,138 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 45a8253ed7304a0997bd5d42d5fe6ecf of snapshot=snaptb-1681055700900 to region=2720147230b846f05cd943c11531e895 table=testCompactionWithHFileLink 2023-04-09 15:55:12,139 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4147cd65e2a64a2abefea0a7610470a2 of snapshot=snaptb-1681055700900 to region=0ae7083b5e65fccc3e4562ffb1cd8cdd table=testCompactionWithHFileLink 2023-04-09 15:55:12,139 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7af52dc4dd584035a1cab3ea5e64325a of snapshot=snaptb-1681055700900 to region=5edb26c74099296449ac252e8aa24185 table=testCompactionWithHFileLink 2023-04-09 15:55:12,143 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8514d9964a5341a690c8eb6f47af97ba of snapshot=snaptb-1681055700900 to region=2720147230b846f05cd943c11531e895 table=testCompactionWithHFileLink 2023-04-09 15:55:12,145 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5da236d0b4594212b2891d90a7b41877 of snapshot=snaptb-1681055700900 to region=0ae7083b5e65fccc3e4562ffb1cd8cdd table=testCompactionWithHFileLink 2023-04-09 15:55:12,145 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 72e08a32ca9a4e97840a12454ee021e6 of snapshot=snaptb-1681055700900 to region=5edb26c74099296449ac252e8aa24185 table=testCompactionWithHFileLink 2023-04-09 15:55:12,150 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9f6f733a0a1949c78db20b5e3437aba1 of snapshot=snaptb-1681055700900 to region=5edb26c74099296449ac252e8aa24185 table=testCompactionWithHFileLink 2023-04-09 15:55:12,154 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1681055700900" table: "testCompactionWithHFileLink" creation_time: 1681055700912 type: FLUSH version: 2 ttl: 0 2023-04-09 15:55:12,155 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1681055712155"}]},"ts":"9223372036854775807"} 2023-04-09 15:55:12,155 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1681055712155"}]},"ts":"9223372036854775807"} 2023-04-09 15:55:12,155 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1681055712155"}]},"ts":"9223372036854775807"} 2023-04-09 15:55:12,158 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-04-09 15:55:12,158 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0ae7083b5e65fccc3e4562ffb1cd8cdd, NAME => 'testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2720147230b846f05cd943c11531e895, NAME => 'testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 5edb26c74099296449ac252e8aa24185, NAME => 'testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185.', STARTKEY => '2', ENDKEY => ''}] 2023-04-09 15:55:12,158 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1681055712156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055712156"}]},"ts":"1681055712156"} 2023-04-09 15:55:12,158 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1681055712156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055712156"}]},"ts":"1681055712156"} 2023-04-09 15:55:12,158 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1681055712156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055712156"}]},"ts":"1681055712156"} 2023-04-09 15:55:12,159 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-04-09 15:55:12,160 INFO [PEWorker-4] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-04-09 15:55:12,160 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 0ae7083b5e65fccc3e4562ffb1cd8cdd, NAME => 'testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2720147230b846f05cd943c11531e895, NAME => 'testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 5edb26c74099296449ac252e8aa24185, NAME => 'testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185.', STARTKEY => '2', ENDKEY => ''}] 2023-04-09 15:55:12,160 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1681055700900 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-04-09 15:55:12,162 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1681055700900" table: "testCompactionWithHFileLink" creation_time: 1681055700912 type: FLUSH version: 2 ttl: 0 ) in 792 msec 2023-04-09 15:55:12,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-04-09 15:55:12,188 INFO [Listener at localhost/39283] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-04-09 15:55:12,188 INFO [Listener at localhost/39283] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1681055700900-1681055709207 2023-04-09 15:55:12,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1681055700900-1681055709207" 2023-04-09 15:55:12,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1681055700900-1681055709207 2023-04-09 15:55:12,197 INFO [Listener at localhost/39283] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-04-09 15:55:12,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-04-09 15:55:12,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-04-09 15:55:12,210 INFO [PEWorker-1] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-04-09 15:55:12,210 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055712210"}]},"ts":"1681055712210"} 2023-04-09 15:55:12,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-04-09 15:55:12,211 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-04-09 15:55:12,213 DEBUG [PEWorker-1] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-04-09 15:55:12,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ae7083b5e65fccc3e4562ffb1cd8cdd, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2720147230b846f05cd943c11531e895, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5edb26c74099296449ac252e8aa24185, ASSIGN}] 2023-04-09 15:55:12,215 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5edb26c74099296449ac252e8aa24185, ASSIGN 2023-04-09 15:55:12,215 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ae7083b5e65fccc3e4562ffb1cd8cdd, ASSIGN 2023-04-09 15:55:12,215 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2720147230b846f05cd943c11531e895, ASSIGN 2023-04-09 15:55:12,216 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5edb26c74099296449ac252e8aa24185, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-04-09 15:55:12,216 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ae7083b5e65fccc3e4562ffb1cd8cdd, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-04-09 15:55:12,217 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2720147230b846f05cd943c11531e895, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-04-09 15:55:12,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-04-09 15:55:12,368 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=0ae7083b5e65fccc3e4562ffb1cd8cdd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:12,368 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=5edb26c74099296449ac252e8aa24185, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:12,368 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=2720147230b846f05cd943c11531e895, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:12,368 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1681055712368"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055712368"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055712368"}]},"ts":"1681055712368"} 2023-04-09 15:55:12,368 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1681055712368"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055712368"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055712368"}]},"ts":"1681055712368"} 2023-04-09 15:55:12,368 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1681055712368"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055712368"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055712368"}]},"ts":"1681055712368"} 2023-04-09 15:55:12,370 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=98, state=RUNNABLE; OpenRegionProcedure 0ae7083b5e65fccc3e4562ffb1cd8cdd, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:55:12,370 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure 5edb26c74099296449ac252e8aa24185, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:55:12,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure 2720147230b846f05cd943c11531e895, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:55:12,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-04-09 15:55:12,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:12,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0ae7083b5e65fccc3e4562ffb1cd8cdd, NAME => 'testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd.', STARTKEY => '', ENDKEY => '1'} 2023-04-09 15:55:12,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:55:12,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:55:12,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:55:12,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:55:12,525 INFO [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:55:12,526 DEBUG [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1 2023-04-09 15:55:12,526 DEBUG [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1 2023-04-09 15:55:12,526 INFO [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ae7083b5e65fccc3e4562ffb1cd8cdd columnFamilyName family1 2023-04-09 15:55:12,537 DEBUG [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-822ee823e4704e678dc7b6d68699ab72 2023-04-09 15:55:12,542 DEBUG [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-a9c534bcf81748ffa74639dbfd3e549f 2023-04-09 15:55:12,547 DEBUG [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-cb9685cb74004119a43bc3a46ba07f3c 2023-04-09 15:55:12,551 DEBUG [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-dbd4ed5695eb4e669873d652ee7ab056 2023-04-09 15:55:12,552 INFO [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] regionserver.HStore(310): Store=0ae7083b5e65fccc3e4562ffb1cd8cdd/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:12,552 INFO [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:55:12,553 DEBUG [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2 2023-04-09 15:55:12,553 DEBUG [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2 2023-04-09 15:55:12,553 INFO [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ae7083b5e65fccc3e4562ffb1cd8cdd columnFamilyName family2 2023-04-09 15:55:12,559 DEBUG [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-4147cd65e2a64a2abefea0a7610470a2 2023-04-09 15:55:12,563 DEBUG [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-5da236d0b4594212b2891d90a7b41877 2023-04-09 15:55:12,568 DEBUG [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-68c6f25961c94c86b3c801d041492736 2023-04-09 15:55:12,577 DEBUG [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-6c675f47fcbe4664a2a107df6f673750 2023-04-09 15:55:12,577 INFO [StoreOpener-0ae7083b5e65fccc3e4562ffb1cd8cdd-1] regionserver.HStore(310): Store=0ae7083b5e65fccc3e4562ffb1cd8cdd/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:12,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:55:12,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:55:12,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-09 15:55:12,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:55:12,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0ae7083b5e65fccc3e4562ffb1cd8cdd; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65820880, jitterRate=-0.01919245719909668}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-09 15:55:12,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0ae7083b5e65fccc3e4562ffb1cd8cdd: 2023-04-09 15:55:12,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd., pid=101, masterSystemTime=1681055712521 2023-04-09 15:55:12,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-04-09 15:55:12,585 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-04-09 15:55:12,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-04-09 15:55:12,586 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-04-09 15:55:12,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:12,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:12,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:12,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5edb26c74099296449ac252e8aa24185, NAME => 'testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185.', STARTKEY => '2', ENDKEY => ''} 2023-04-09 15:55:12,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 5edb26c74099296449ac252e8aa24185 2023-04-09 15:55:12,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:55:12,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5edb26c74099296449ac252e8aa24185 2023-04-09 15:55:12,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5edb26c74099296449ac252e8aa24185 2023-04-09 15:55:12,588 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=0ae7083b5e65fccc3e4562ffb1cd8cdd, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:12,588 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1681055712588"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055712588"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055712588"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055712588"}]},"ts":"1681055712588"} 2023-04-09 15:55:12,589 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-04-09 15:55:12,589 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1912): 0ae7083b5e65fccc3e4562ffb1cd8cdd/family2 is initiating minor compaction (all files) 2023-04-09 15:55:12,589 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0ae7083b5e65fccc3e4562ffb1cd8cdd/family2 in testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:12,589 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-68c6f25961c94c86b3c801d041492736, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-6c675f47fcbe4664a2a107df6f673750, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-4147cd65e2a64a2abefea0a7610470a2, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-5da236d0b4594212b2891d90a7b41877] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp, totalSize=20.4 K 2023-04-09 15:55:12,590 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-04-09 15:55:12,590 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.HStore(1912): 0ae7083b5e65fccc3e4562ffb1cd8cdd/family1 is initiating minor compaction (all files) 2023-04-09 15:55:12,591 INFO [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 0ae7083b5e65fccc3e4562ffb1cd8cdd/family1 in testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:12,591 INFO [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-a9c534bcf81748ffa74639dbfd3e549f, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-cb9685cb74004119a43bc3a46ba07f3c, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-dbd4ed5695eb4e669873d652ee7ab056, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-822ee823e4704e678dc7b6d68699ab72] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp, totalSize=21.6 K 2023-04-09 15:55:12,591 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-68c6f25961c94c86b3c801d041492736, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055695107 2023-04-09 15:55:12,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=98 2023-04-09 15:55:12,591 INFO [StoreOpener-5edb26c74099296449ac252e8aa24185-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5edb26c74099296449ac252e8aa24185 2023-04-09 15:55:12,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=98, state=SUCCESS; OpenRegionProcedure 0ae7083b5e65fccc3e4562ffb1cd8cdd, server=jenkins-hbase4.apache.org,44869,1681055618167 in 220 msec 2023-04-09 15:55:12,592 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-6c675f47fcbe4664a2a107df6f673750, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055696517 2023-04-09 15:55:12,592 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-a9c534bcf81748ffa74639dbfd3e549f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055695107 2023-04-09 15:55:12,593 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ae7083b5e65fccc3e4562ffb1cd8cdd, ASSIGN in 378 msec 2023-04-09 15:55:12,593 DEBUG [StoreOpener-5edb26c74099296449ac252e8aa24185-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1 2023-04-09 15:55:12,593 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-4147cd65e2a64a2abefea0a7610470a2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055697966 2023-04-09 15:55:12,593 DEBUG [StoreOpener-5edb26c74099296449ac252e8aa24185-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1 2023-04-09 15:55:12,593 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-cb9685cb74004119a43bc3a46ba07f3c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055696517 2023-04-09 15:55:12,594 INFO [StoreOpener-5edb26c74099296449ac252e8aa24185-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5edb26c74099296449ac252e8aa24185 columnFamilyName family1 2023-04-09 15:55:12,594 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-5da236d0b4594212b2891d90a7b41877, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055699430 2023-04-09 15:55:12,594 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-dbd4ed5695eb4e669873d652ee7ab056, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055697966 2023-04-09 15:55:12,596 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-822ee823e4704e678dc7b6d68699ab72, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055699430 2023-04-09 15:55:12,611 DEBUG [StoreOpener-5edb26c74099296449ac252e8aa24185-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-27bfe4cf580941419fe1ee530dad30ed 2023-04-09 15:55:12,619 DEBUG [StoreOpener-5edb26c74099296449ac252e8aa24185-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-46a363d96db148fa8e2a0428ef48e5de 2023-04-09 15:55:12,623 INFO [RS:0;jenkins-hbase4:44869-longCompactions-0] throttle.PressureAwareThroughputController(145): 0ae7083b5e65fccc3e4562ffb1cd8cdd#family1#compaction#113 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 65.38 MB/second 2023-04-09 15:55:12,624 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0ae7083b5e65fccc3e4562ffb1cd8cdd#family2#compaction#114 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-04-09 15:55:12,626 DEBUG [StoreOpener-5edb26c74099296449ac252e8aa24185-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-631c4c55741a4999a4a87883f7cad6aa 2023-04-09 15:55:12,634 DEBUG [StoreOpener-5edb26c74099296449ac252e8aa24185-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-ff23ebbd09f64cd09a309c5eacd98052 2023-04-09 15:55:12,634 INFO [StoreOpener-5edb26c74099296449ac252e8aa24185-1] regionserver.HStore(310): Store=5edb26c74099296449ac252e8aa24185/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:12,635 INFO [StoreOpener-5edb26c74099296449ac252e8aa24185-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5edb26c74099296449ac252e8aa24185 2023-04-09 15:55:12,635 DEBUG [StoreOpener-5edb26c74099296449ac252e8aa24185-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2 2023-04-09 15:55:12,636 DEBUG [StoreOpener-5edb26c74099296449ac252e8aa24185-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2 2023-04-09 15:55:12,636 INFO [StoreOpener-5edb26c74099296449ac252e8aa24185-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5edb26c74099296449ac252e8aa24185 columnFamilyName family2 2023-04-09 15:55:12,641 DEBUG [StoreOpener-5edb26c74099296449ac252e8aa24185-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-48c8a7dae6bf41859cf8faf76194adcf 2023-04-09 15:55:12,646 DEBUG [StoreOpener-5edb26c74099296449ac252e8aa24185-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-72e08a32ca9a4e97840a12454ee021e6 2023-04-09 15:55:12,650 DEBUG [StoreOpener-5edb26c74099296449ac252e8aa24185-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-7af52dc4dd584035a1cab3ea5e64325a 2023-04-09 15:55:12,653 DEBUG [StoreOpener-5edb26c74099296449ac252e8aa24185-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-9f6f733a0a1949c78db20b5e3437aba1 2023-04-09 15:55:12,654 INFO [StoreOpener-5edb26c74099296449ac252e8aa24185-1] regionserver.HStore(310): Store=5edb26c74099296449ac252e8aa24185/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:12,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185 2023-04-09 15:55:12,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185 2023-04-09 15:55:12,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-09 15:55:12,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5edb26c74099296449ac252e8aa24185 2023-04-09 15:55:12,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5edb26c74099296449ac252e8aa24185; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65981926, jitterRate=-0.01679268479347229}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-09 15:55:12,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5edb26c74099296449ac252e8aa24185: 2023-04-09 15:55:12,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185., pid=102, masterSystemTime=1681055712521 2023-04-09 15:55:12,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-04-09 15:55:12,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-04-09 15:55:12,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:12,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:12,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:12,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2720147230b846f05cd943c11531e895, NAME => 'testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895.', STARTKEY => '1', ENDKEY => '2'} 2023-04-09 15:55:12,660 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=5edb26c74099296449ac252e8aa24185, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:12,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 2720147230b846f05cd943c11531e895 2023-04-09 15:55:12,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:55:12,660 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1681055712660"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055712660"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055712660"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055712660"}]},"ts":"1681055712660"} 2023-04-09 15:55:12,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2720147230b846f05cd943c11531e895 2023-04-09 15:55:12,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2720147230b846f05cd943c11531e895 2023-04-09 15:55:12,661 INFO [StoreOpener-2720147230b846f05cd943c11531e895-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2720147230b846f05cd943c11531e895 2023-04-09 15:55:12,662 DEBUG [StoreOpener-2720147230b846f05cd943c11531e895-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1 2023-04-09 15:55:12,662 DEBUG [StoreOpener-2720147230b846f05cd943c11531e895-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1 2023-04-09 15:55:12,663 INFO [StoreOpener-2720147230b846f05cd943c11531e895-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2720147230b846f05cd943c11531e895 columnFamilyName family1 2023-04-09 15:55:12,663 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-04-09 15:55:12,663 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure 5edb26c74099296449ac252e8aa24185, server=jenkins-hbase4.apache.org,44869,1681055618167 in 291 msec 2023-04-09 15:55:12,664 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5edb26c74099296449ac252e8aa24185, ASSIGN in 449 msec 2023-04-09 15:55:12,669 DEBUG [StoreOpener-2720147230b846f05cd943c11531e895-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-4fabf06a69a84990b1fe22deb6848ae3 2023-04-09 15:55:12,675 DEBUG [StoreOpener-2720147230b846f05cd943c11531e895-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-99243ed4dfad4f929375bf026305cf72 2023-04-09 15:55:12,681 DEBUG [StoreOpener-2720147230b846f05cd943c11531e895-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-9fa1549e2a5f49faa4929250f248676b 2023-04-09 15:55:12,686 DEBUG [StoreOpener-2720147230b846f05cd943c11531e895-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-ea11e2e967494f6ab6e9f3eb6ab26e68 2023-04-09 15:55:12,687 INFO [StoreOpener-2720147230b846f05cd943c11531e895-1] regionserver.HStore(310): Store=2720147230b846f05cd943c11531e895/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:12,687 INFO [StoreOpener-2720147230b846f05cd943c11531e895-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2720147230b846f05cd943c11531e895 2023-04-09 15:55:12,688 DEBUG [StoreOpener-2720147230b846f05cd943c11531e895-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2 2023-04-09 15:55:12,688 DEBUG [StoreOpener-2720147230b846f05cd943c11531e895-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2 2023-04-09 15:55:12,688 INFO [StoreOpener-2720147230b846f05cd943c11531e895-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2720147230b846f05cd943c11531e895 columnFamilyName family2 2023-04-09 15:55:12,695 DEBUG [StoreOpener-2720147230b846f05cd943c11531e895-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-27ea281ccac2403283dcc700b50f015d 2023-04-09 15:55:12,701 DEBUG [StoreOpener-2720147230b846f05cd943c11531e895-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-45a8253ed7304a0997bd5d42d5fe6ecf 2023-04-09 15:55:12,706 DEBUG [StoreOpener-2720147230b846f05cd943c11531e895-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-6034a543e7964a0caf90eba11d97eb06 2023-04-09 15:55:12,711 DEBUG [StoreOpener-2720147230b846f05cd943c11531e895-1] regionserver.HStore(539): loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-8514d9964a5341a690c8eb6f47af97ba 2023-04-09 15:55:12,711 INFO [StoreOpener-2720147230b846f05cd943c11531e895-1] regionserver.HStore(310): Store=2720147230b846f05cd943c11531e895/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:12,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895 2023-04-09 15:55:12,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895 2023-04-09 15:55:12,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-09 15:55:12,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2720147230b846f05cd943c11531e895 2023-04-09 15:55:12,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2720147230b846f05cd943c11531e895; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67526985, jitterRate=0.006230488419532776}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-09 15:55:12,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2720147230b846f05cd943c11531e895: 2023-04-09 15:55:12,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895., pid=103, masterSystemTime=1681055712521 2023-04-09 15:55:12,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-04-09 15:55:12,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-04-09 15:55:12,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:12,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:12,719 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=2720147230b846f05cd943c11531e895, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:12,719 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1681055712719"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055712719"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055712719"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055712719"}]},"ts":"1681055712719"} 2023-04-09 15:55:12,722 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=99 2023-04-09 15:55:12,722 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure 2720147230b846f05cd943c11531e895, server=jenkins-hbase4.apache.org,44869,1681055618167 in 350 msec 2023-04-09 15:55:12,723 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=99, resume processing ppid=97 2023-04-09 15:55:12,723 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2720147230b846f05cd943c11531e895, ASSIGN in 508 msec 2023-04-09 15:55:12,724 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055712724"}]},"ts":"1681055712724"} 2023-04-09 15:55:12,725 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-04-09 15:55:12,727 INFO [PEWorker-1] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-04-09 15:55:12,728 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 524 msec 2023-04-09 15:55:12,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-04-09 15:55:12,814 INFO [Listener at localhost/39283] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-04-09 15:55:12,826 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:12,833 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:12,841 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:12,842 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:12,848 INFO [Listener at localhost/39283] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-04-09 15:55:12,860 INFO [Listener at localhost/39283] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-04-09 15:55:12,860 INFO [Listener at localhost/39283] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-04-09 15:55:12,860 DEBUG [Listener at localhost/39283] zookeeper.ReadOnlyZKClient(139): Connect 0x567a176b to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:55:12,864 DEBUG [Listener at localhost/39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5289509b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:55:12,865 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230409 for table='testCompactionWithHFileLink' and column='family1' 2023-04-09 15:55:12,865 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230409 for table='testCompactionWithHFileLink' and column='family1' 2023-04-09 15:55:12,865 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230409 for table='testCompactionWithHFileLink' and column='family1' 2023-04-09 15:55:13,321 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230409fc1fbdbabf634305b9afd567e1d3571e to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230409fc1fbdbabf634305b9afd567e1d3571e 2023-04-09 15:55:13,322 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230409 table='testCompactionWithHFileLink' column='family1' 2023-04-09 15:55:13,323 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409bfcc0f3610a6496eba478f067fee6bd8 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230409bfcc0f3610a6496eba478f067fee6bd8 2023-04-09 15:55:13,324 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230409 table='testCompactionWithHFileLink' column='family1' 2023-04-09 15:55:13,336 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:55:13,339 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:55:13,345 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-09 15:55:13,349 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44456, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-09 15:55:13,367 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230409/family1/e169c125a40b4002ae159b758ae29518 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-04-09 15:55:13,368 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230409/family1/e169c125a40b4002ae159b758ae29518}] 2023-04-09 15:55:13,371 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230409/family1/56b803ce22684d57a65dbb0d940bb6d7 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-04-09 15:55:13,375 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230409/family1/56b803ce22684d57a65dbb0d940bb6d7}] 2023-04-09 15:55:13,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230409/family1/e169c125a40b4002ae159b758ae29518 for inclusion in 5edb26c74099296449ac252e8aa24185/family1 2023-04-09 15:55:13,378 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230409/family1/56b803ce22684d57a65dbb0d940bb6d7 for inclusion in 2720147230b846f05cd943c11531e895/family1 2023-04-09 15:55:13,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-04-09 15:55:13,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-04-09 15:55:13,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(777): Region bounds: first=1 last=2 2023-04-09 15:55:13,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(777): Region bounds: first=2 last= 2023-04-09 15:55:13,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for 2720147230b846f05cd943c11531e895: 2023-04-09 15:55:13,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for 5edb26c74099296449ac252e8aa24185: 2023-04-09 15:55:13,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230409/family1/56b803ce22684d57a65dbb0d940bb6d7 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__pc7dieqh6bgglkuucouv0fmv281p1t59p4ep97befemlvbcrnci6u0c15pp77oa3/family1/56b803ce22684d57a65dbb0d940bb6d7 2023-04-09 15:55:13,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230409/family1/e169c125a40b4002ae159b758ae29518 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__5sd54do7smsg894rprvksp60satpi3kh3avqnurb11687bpc2p7k366k2rggmk3i/family1/e169c125a40b4002ae159b758ae29518 2023-04-09 15:55:13,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__pc7dieqh6bgglkuucouv0fmv281p1t59p4ep97befemlvbcrnci6u0c15pp77oa3/family1/56b803ce22684d57a65dbb0d940bb6d7 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/b46e303d51b545a8b9e3f1df9fe1345a_SeqId_34_ 2023-04-09 15:55:13,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__5sd54do7smsg894rprvksp60satpi3kh3avqnurb11687bpc2p7k366k2rggmk3i/family1/e169c125a40b4002ae159b758ae29518 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/1b4fc67c825544378643e96ae8827bad_SeqId_34_ 2023-04-09 15:55:13,383 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__pc7dieqh6bgglkuucouv0fmv281p1t59p4ep97befemlvbcrnci6u0c15pp77oa3/family1/56b803ce22684d57a65dbb0d940bb6d7 into 2720147230b846f05cd943c11531e895/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/b46e303d51b545a8b9e3f1df9fe1345a_SeqId_34_ - updating store file list. 2023-04-09 15:55:13,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__5sd54do7smsg894rprvksp60satpi3kh3avqnurb11687bpc2p7k366k2rggmk3i/family1/e169c125a40b4002ae159b758ae29518 into 5edb26c74099296449ac252e8aa24185/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/1b4fc67c825544378643e96ae8827bad_SeqId_34_ - updating store file list. 2023-04-09 15:55:13,386 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/b46e303d51b545a8b9e3f1df9fe1345a_SeqId_34_ into 2720147230b846f05cd943c11531e895/family1 2023-04-09 15:55:13,386 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__pc7dieqh6bgglkuucouv0fmv281p1t59p4ep97befemlvbcrnci6u0c15pp77oa3/family1/56b803ce22684d57a65dbb0d940bb6d7 into 2720147230b846f05cd943c11531e895/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/b46e303d51b545a8b9e3f1df9fe1345a_SeqId_34_) 2023-04-09 15:55:13,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/1b4fc67c825544378643e96ae8827bad_SeqId_34_ into 5edb26c74099296449ac252e8aa24185/family1 2023-04-09 15:55:13,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__5sd54do7smsg894rprvksp60satpi3kh3avqnurb11687bpc2p7k366k2rggmk3i/family1/e169c125a40b4002ae159b758ae29518 into 5edb26c74099296449ac252e8aa24185/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/1b4fc67c825544378643e96ae8827bad_SeqId_34_) 2023-04-09 15:55:13,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__pc7dieqh6bgglkuucouv0fmv281p1t59p4ep97befemlvbcrnci6u0c15pp77oa3/family1/56b803ce22684d57a65dbb0d940bb6d7 2023-04-09 15:55:13,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__5sd54do7smsg894rprvksp60satpi3kh3avqnurb11687bpc2p7k366k2rggmk3i/family1/e169c125a40b4002ae159b758ae29518 2023-04-09 15:55:13,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:13,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-04-09 15:55:13,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.HStore(1912): 2720147230b846f05cd943c11531e895/family1 is initiating minor compaction (all files) 2023-04-09 15:55:13,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44869] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@35b88edd; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-04-09 15:55:13,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:13,390 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230409 table='testCompactionWithHFileLink' column='family1' 2023-04-09 15:55:13,391 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:13,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-04-09 15:55:13,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(1912): 5edb26c74099296449ac252e8aa24185/family1 is initiating minor compaction (all files) 2023-04-09 15:55:13,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5c07c38a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-04-09 15:55:13,392 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023040931ad9321e8674aa8991061368bf3b1d4 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023040931ad9321e8674aa8991061368bf3b1d4 2023-04-09 15:55:13,393 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230409 table='testCompactionWithHFileLink' column='family1' 2023-04-09 15:55:13,393 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230409544d36343520473a9a86321189e90cf9 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230409544d36343520473a9a86321189e90cf9 2023-04-09 15:55:13,393 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:13,394 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202304095976a4b334664952a003191ed0db432e to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202304095976a4b334664952a003191ed0db432e 2023-04-09 15:55:13,394 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023040938d91309f2d645ceae048ace07c171fb to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023040938d91309f2d645ceae048ace07c171fb 2023-04-09 15:55:13,395 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202304098be8de8eb1514b8cbadbc106cd83b365 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202304098be8de8eb1514b8cbadbc106cd83b365 2023-04-09 15:55:13,395 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-04-09 15:55:13,395 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230409' 2023-04-09 15:55:13,395 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230409a029596bc9cc4e35be5c80b0dd75d03b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230409a029596bc9cc4e35be5c80b0dd75d03b 2023-04-09 15:55:13,395 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230409 for table='testCompactionWithHFileLink' and column='family1' 2023-04-09 15:55:13,396 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230409e5f4bd2fe7b34bc1a6bfb070651d0ecd to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230409e5f4bd2fe7b34bc1a6bfb070651d0ecd 2023-04-09 15:55:13,397 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230409f0eec9b8918e4ede924f48521003bc95 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230409f0eec9b8918e4ede924f48521003bc95 2023-04-09 15:55:13,397 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-04-09 15:55:13,397 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230409' 2023-04-09 15:55:13,398 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230409 for table='testCompactionWithHFileLink' and column='family1' 2023-04-09 15:55:13,444 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family2/889847fbf98345bca260d2065f5e36b8 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/889847fbf98345bca260d2065f5e36b8 2023-04-09 15:55:13,448 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-04-09 15:55:13,448 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 0ae7083b5e65fccc3e4562ffb1cd8cdd/family2 of 0ae7083b5e65fccc3e4562ffb1cd8cdd into 889847fbf98345bca260d2065f5e36b8(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:55:13,448 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0ae7083b5e65fccc3e4562ffb1cd8cdd: 2023-04-09 15:55:13,449 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd., storeName=0ae7083b5e65fccc3e4562ffb1cd8cdd/family2, priority=12, startTime=1681055712585; duration=0sec 2023-04-09 15:55:13,449 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-04-09 15:55:13,449 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2720147230b846f05cd943c11531e895/family1 in testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:13,449 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-4fabf06a69a84990b1fe22deb6848ae3, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-99243ed4dfad4f929375bf026305cf72, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-9fa1549e2a5f49faa4929250f248676b, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-ea11e2e967494f6ab6e9f3eb6ab26e68, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/b46e303d51b545a8b9e3f1df9fe1345a_SeqId_34_] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp, totalSize=28.9 K 2023-04-09 15:55:13,449 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-4fabf06a69a84990b1fe22deb6848ae3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055695109 2023-04-09 15:55:13,450 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-99243ed4dfad4f929375bf026305cf72, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055696517 2023-04-09 15:55:13,450 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-9fa1549e2a5f49faa4929250f248676b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055697967 2023-04-09 15:55:13,451 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-ea11e2e967494f6ab6e9f3eb6ab26e68, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055699430 2023-04-09 15:55:13,451 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting b46e303d51b545a8b9e3f1df9fe1345a_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1681055695109 2023-04-09 15:55:13,463 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2720147230b846f05cd943c11531e895#family1#compaction#115 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-04-09 15:55:13,474 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-68c6f25961c94c86b3c801d041492736, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-6c675f47fcbe4664a2a107df6f673750, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-4147cd65e2a64a2abefea0a7610470a2, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-5da236d0b4594212b2891d90a7b41877] to archive 2023-04-09 15:55:13,475 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:13,476 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-68c6f25961c94c86b3c801d041492736 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-68c6f25961c94c86b3c801d041492736 2023-04-09 15:55:13,477 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-6c675f47fcbe4664a2a107df6f673750 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-6c675f47fcbe4664a2a107df6f673750 2023-04-09 15:55:13,478 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-4147cd65e2a64a2abefea0a7610470a2 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-4147cd65e2a64a2abefea0a7610470a2 2023-04-09 15:55:13,479 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-5da236d0b4594212b2891d90a7b41877 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family2/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-5da236d0b4594212b2891d90a7b41877 2023-04-09 15:55:13,721 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409d1a513707b77414fa9268753a7e70543 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230409d1a513707b77414fa9268753a7e70543 2023-04-09 15:55:13,722 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230409 table='testCompactionWithHFileLink' column='family1' 2023-04-09 15:55:13,745 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230409/family1/894dbd2bf76a41a5a102a14cea03c493 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-04-09 15:55:13,745 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=32 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230409/family1/894dbd2bf76a41a5a102a14cea03c493}] 2023-04-09 15:55:13,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230409/family1/894dbd2bf76a41a5a102a14cea03c493 for inclusion in 0ae7083b5e65fccc3e4562ffb1cd8cdd/family1 2023-04-09 15:55:13,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-04-09 15:55:13,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last=1 2023-04-09 15:55:13,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for 0ae7083b5e65fccc3e4562ffb1cd8cdd: 2023-04-09 15:55:13,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230409/family1/894dbd2bf76a41a5a102a14cea03c493 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__hhgf3s4rq38b5k3bc6to2r3bbc4a0hro22pib8oull4nhd6lj04rg3f8n8nuuh9e/family1/894dbd2bf76a41a5a102a14cea03c493 2023-04-09 15:55:13,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__hhgf3s4rq38b5k3bc6to2r3bbc4a0hro22pib8oull4nhd6lj04rg3f8n8nuuh9e/family1/894dbd2bf76a41a5a102a14cea03c493 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/ea5b1c32dc8647c28d52c91d8936b3d4_SeqId_35_ 2023-04-09 15:55:13,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__hhgf3s4rq38b5k3bc6to2r3bbc4a0hro22pib8oull4nhd6lj04rg3f8n8nuuh9e/family1/894dbd2bf76a41a5a102a14cea03c493 into 0ae7083b5e65fccc3e4562ffb1cd8cdd/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/ea5b1c32dc8647c28d52c91d8936b3d4_SeqId_35_ - updating store file list. 2023-04-09 15:55:13,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/ea5b1c32dc8647c28d52c91d8936b3d4_SeqId_35_ into 0ae7083b5e65fccc3e4562ffb1cd8cdd/family1 2023-04-09 15:55:13,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__hhgf3s4rq38b5k3bc6to2r3bbc4a0hro22pib8oull4nhd6lj04rg3f8n8nuuh9e/family1/894dbd2bf76a41a5a102a14cea03c493 into 0ae7083b5e65fccc3e4562ffb1cd8cdd/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/ea5b1c32dc8647c28d52c91d8936b3d4_SeqId_35_) 2023-04-09 15:55:13,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testCompactionWithHFileLink__hhgf3s4rq38b5k3bc6to2r3bbc4a0hro22pib8oull4nhd6lj04rg3f8n8nuuh9e/family1/894dbd2bf76a41a5a102a14cea03c493 2023-04-09 15:55:13,756 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230409 table='testCompactionWithHFileLink' column='family1' 2023-04-09 15:55:13,757 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:13,758 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023040908d0dfb685444d24bf8e997250823d01 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023040908d0dfb685444d24bf8e997250823d01 2023-04-09 15:55:13,759 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230409525e35a922af42e7bf71c42be5460e73 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230409525e35a922af42e7bf71c42be5460e73 2023-04-09 15:55:13,760 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230409d3db5ee0905a4d67b84c282558c90c9f to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230409d3db5ee0905a4d67b84c282558c90c9f 2023-04-09 15:55:13,760 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230409ea6b65a7d4ba48299de583656fe52652 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230409ea6b65a7d4ba48299de583656fe52652 2023-04-09 15:55:13,760 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-04-09 15:55:13,760 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230409' 2023-04-09 15:55:13,761 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230409 for table='testCompactionWithHFileLink' and column='family1' 2023-04-09 15:55:13,761 INFO [Listener at localhost/39283] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-04-09 15:55:13,764 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:13,766 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:13,769 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:13,770 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:13,775 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:13,776 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:13,792 INFO [Listener at localhost/39283] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=285 (was 237) - Thread LEAK? -, OpenFileDescriptor=757 (was 598) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=384 (was 383) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=1442 (was 1592) 2023-04-09 15:55:13,804 INFO [Listener at localhost/39283] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=285, OpenFileDescriptor=757, MaxFileDescriptor=60000, SystemLoadAverage=384, ProcessCount=169, AvailableMemoryMB=1441 2023-04-09 15:55:13,809 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-04-09 15:55:13,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-04-09 15:55:13,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-04-09 15:55:13,816 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-04-09 15:55:13,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 9 msec 2023-04-09 15:55:13,844 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/.tmp/family1/6af909797b6246109deec015f4fe0647 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/6af909797b6246109deec015f4fe0647 2023-04-09 15:55:13,849 INFO [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 0ae7083b5e65fccc3e4562ffb1cd8cdd/family1 of 0ae7083b5e65fccc3e4562ffb1cd8cdd into 6af909797b6246109deec015f4fe0647(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-09 15:55:13,850 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0ae7083b5e65fccc3e4562ffb1cd8cdd: 2023-04-09 15:55:13,850 INFO [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd., storeName=0ae7083b5e65fccc3e4562ffb1cd8cdd/family1, priority=12, startTime=1681055712585; duration=1sec 2023-04-09 15:55:13,850 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-04-09 15:55:13,850 INFO [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 5edb26c74099296449ac252e8aa24185/family1 in testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:13,850 INFO [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-631c4c55741a4999a4a87883f7cad6aa, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-46a363d96db148fa8e2a0428ef48e5de, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-27bfe4cf580941419fe1ee530dad30ed, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-ff23ebbd09f64cd09a309c5eacd98052, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/1b4fc67c825544378643e96ae8827bad_SeqId_34_] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp, totalSize=28.9 K 2023-04-09 15:55:13,851 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-631c4c55741a4999a4a87883f7cad6aa, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055695110 2023-04-09 15:55:13,851 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-46a363d96db148fa8e2a0428ef48e5de, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055696517 2023-04-09 15:55:13,852 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-27bfe4cf580941419fe1ee530dad30ed, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055697967 2023-04-09 15:55:13,852 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-ff23ebbd09f64cd09a309c5eacd98052, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055699430 2023-04-09 15:55:13,852 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] compactions.Compactor(207): Compacting 1b4fc67c825544378643e96ae8827bad_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1681055695110 2023-04-09 15:55:13,865 INFO [RS:0;jenkins-hbase4:44869-longCompactions-0] throttle.PressureAwareThroughputController(145): 5edb26c74099296449ac252e8aa24185#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-04-09 15:55:13,872 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-a9c534bcf81748ffa74639dbfd3e549f, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-cb9685cb74004119a43bc3a46ba07f3c, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-dbd4ed5695eb4e669873d652ee7ab056, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-822ee823e4704e678dc7b6d68699ab72] to archive 2023-04-09 15:55:13,873 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:13,874 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-a9c534bcf81748ffa74639dbfd3e549f to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-a9c534bcf81748ffa74639dbfd3e549f 2023-04-09 15:55:13,875 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-cb9685cb74004119a43bc3a46ba07f3c to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-cb9685cb74004119a43bc3a46ba07f3c 2023-04-09 15:55:13,876 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-dbd4ed5695eb4e669873d652ee7ab056 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-dbd4ed5695eb4e669873d652ee7ab056 2023-04-09 15:55:13,877 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-822ee823e4704e678dc7b6d68699ab72 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/family1/testCompactionWithHFileLink=0ae7083b5e65fccc3e4562ffb1cd8cdd-822ee823e4704e678dc7b6d68699ab72 2023-04-09 15:55:13,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-04-09 15:55:13,916 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-04-09 15:55:13,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-04-09 15:55:13,918 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-04-09 15:55:13,918 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-04-09 15:55:13,919 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-09 15:55:13,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-04-09 15:55:13,921 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a 2023-04-09 15:55:13,921 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075 2023-04-09 15:55:13,921 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261 2023-04-09 15:55:13,921 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a empty. 2023-04-09 15:55:13,921 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075 empty. 2023-04-09 15:55:13,921 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261 empty. 2023-04-09 15:55:13,921 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a 2023-04-09 15:55:13,922 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075 2023-04-09 15:55:13,922 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261 2023-04-09 15:55:13,922 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-04-09 15:55:14,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-04-09 15:55:14,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-04-09 15:55:14,328 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-04-09 15:55:14,329 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => ff29b220fa2e52fe8f06bb62f0a0c261, NAME => 'ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:55:14,330 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => ffe3cc2905f4a676202562918179e075, NAME => 'ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:55:14,330 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => e8d74bc0fb5ce674b95adc8cb94da50a, NAME => 'ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:55:14,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-04-09 15:55:14,593 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-09 15:55:14,680 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family1/7caee80d49154097976dca0efb5177fb as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/7caee80d49154097976dca0efb5177fb 2023-04-09 15:55:14,684 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 2720147230b846f05cd943c11531e895/family1 of 2720147230b846f05cd943c11531e895 into 7caee80d49154097976dca0efb5177fb(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-09 15:55:14,684 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2720147230b846f05cd943c11531e895: 2023-04-09 15:55:14,684 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1681055713388; duration=1sec 2023-04-09 15:55:14,684 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-04-09 15:55:14,684 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-04-09 15:55:14,686 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-04-09 15:55:14,686 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1912): 5edb26c74099296449ac252e8aa24185/family2 is initiating minor compaction (all files) 2023-04-09 15:55:14,686 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5edb26c74099296449ac252e8aa24185/family2 in testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:14,686 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-48c8a7dae6bf41859cf8faf76194adcf, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-7af52dc4dd584035a1cab3ea5e64325a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-72e08a32ca9a4e97840a12454ee021e6, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-9f6f733a0a1949c78db20b5e3437aba1] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp, totalSize=20.4 K 2023-04-09 15:55:14,687 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-48c8a7dae6bf41859cf8faf76194adcf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055695110 2023-04-09 15:55:14,687 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-7af52dc4dd584035a1cab3ea5e64325a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055696517 2023-04-09 15:55:14,688 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-72e08a32ca9a4e97840a12454ee021e6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055697967 2023-04-09 15:55:14,688 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-9f6f733a0a1949c78db20b5e3437aba1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055699430 2023-04-09 15:55:14,699 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5edb26c74099296449ac252e8aa24185#family2#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-04-09 15:55:14,735 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:55:14,735 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing ff29b220fa2e52fe8f06bb62f0a0c261, disabling compactions & flushes 2023-04-09 15:55:14,735 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:14,735 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:55:14,735 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:14,735 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing ffe3cc2905f4a676202562918179e075, disabling compactions & flushes 2023-04-09 15:55:14,735 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. after waiting 0 ms 2023-04-09 15:55:14,735 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:55:14,735 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:14,735 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:14,735 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:14,735 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:14,735 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for ff29b220fa2e52fe8f06bb62f0a0c261: 2023-04-09 15:55:14,735 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing e8d74bc0fb5ce674b95adc8cb94da50a, disabling compactions & flushes 2023-04-09 15:55:14,735 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. after waiting 0 ms 2023-04-09 15:55:14,735 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:14,735 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:14,736 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:14,736 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:14,736 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. after waiting 0 ms 2023-04-09 15:55:14,736 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for ffe3cc2905f4a676202562918179e075: 2023-04-09 15:55:14,736 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:14,736 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:14,736 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for e8d74bc0fb5ce674b95adc8cb94da50a: 2023-04-09 15:55:14,738 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-04-09 15:55:14,739 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1681055714738"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055714738"}]},"ts":"1681055714738"} 2023-04-09 15:55:14,739 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1681055714738"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055714738"}]},"ts":"1681055714738"} 2023-04-09 15:55:14,739 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1681055714738"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055714738"}]},"ts":"1681055714738"} 2023-04-09 15:55:14,740 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-04-09 15:55:14,741 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-09 15:55:14,741 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055714741"}]},"ts":"1681055714741"} 2023-04-09 15:55:14,742 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-04-09 15:55:14,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=e8d74bc0fb5ce674b95adc8cb94da50a, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ffe3cc2905f4a676202562918179e075, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ff29b220fa2e52fe8f06bb62f0a0c261, ASSIGN}] 2023-04-09 15:55:14,747 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=e8d74bc0fb5ce674b95adc8cb94da50a, ASSIGN 2023-04-09 15:55:14,747 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ffe3cc2905f4a676202562918179e075, ASSIGN 2023-04-09 15:55:14,748 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ff29b220fa2e52fe8f06bb62f0a0c261, ASSIGN 2023-04-09 15:55:14,748 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=e8d74bc0fb5ce674b95adc8cb94da50a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:55:14,748 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ff29b220fa2e52fe8f06bb62f0a0c261, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:55:14,748 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ffe3cc2905f4a676202562918179e075, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:55:14,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-4fabf06a69a84990b1fe22deb6848ae3, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-99243ed4dfad4f929375bf026305cf72, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-9fa1549e2a5f49faa4929250f248676b, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-ea11e2e967494f6ab6e9f3eb6ab26e68, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/b46e303d51b545a8b9e3f1df9fe1345a_SeqId_34_] to archive 2023-04-09 15:55:14,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:14,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-4fabf06a69a84990b1fe22deb6848ae3 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-4fabf06a69a84990b1fe22deb6848ae3 2023-04-09 15:55:14,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-99243ed4dfad4f929375bf026305cf72 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-99243ed4dfad4f929375bf026305cf72 2023-04-09 15:55:14,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-9fa1549e2a5f49faa4929250f248676b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-9fa1549e2a5f49faa4929250f248676b 2023-04-09 15:55:14,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-ea11e2e967494f6ab6e9f3eb6ab26e68 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-ea11e2e967494f6ab6e9f3eb6ab26e68 2023-04-09 15:55:14,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/b46e303d51b545a8b9e3f1df9fe1345a_SeqId_34_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family1/b46e303d51b545a8b9e3f1df9fe1345a_SeqId_34_ 2023-04-09 15:55:14,900 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e8d74bc0fb5ce674b95adc8cb94da50a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:14,900 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=ff29b220fa2e52fe8f06bb62f0a0c261, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:14,900 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=ffe3cc2905f4a676202562918179e075, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:14,901 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1681055714900"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055714900"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055714900"}]},"ts":"1681055714900"} 2023-04-09 15:55:14,901 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1681055714900"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055714900"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055714900"}]},"ts":"1681055714900"} 2023-04-09 15:55:14,901 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1681055714900"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055714900"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055714900"}]},"ts":"1681055714900"} 2023-04-09 15:55:14,902 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure e8d74bc0fb5ce674b95adc8cb94da50a, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:55:14,902 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure ff29b220fa2e52fe8f06bb62f0a0c261, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:55:14,903 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure ffe3cc2905f4a676202562918179e075, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:55:15,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-04-09 15:55:15,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:15,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e8d74bc0fb5ce674b95adc8cb94da50a, NAME => 'ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a.', STARTKEY => '', ENDKEY => '1'} 2023-04-09 15:55:15,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction e8d74bc0fb5ce674b95adc8cb94da50a 2023-04-09 15:55:15,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:55:15,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e8d74bc0fb5ce674b95adc8cb94da50a 2023-04-09 15:55:15,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e8d74bc0fb5ce674b95adc8cb94da50a 2023-04-09 15:55:15,057 INFO [StoreOpener-e8d74bc0fb5ce674b95adc8cb94da50a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e8d74bc0fb5ce674b95adc8cb94da50a 2023-04-09 15:55:15,058 DEBUG [StoreOpener-e8d74bc0fb5ce674b95adc8cb94da50a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1 2023-04-09 15:55:15,059 DEBUG [StoreOpener-e8d74bc0fb5ce674b95adc8cb94da50a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1 2023-04-09 15:55:15,059 INFO [StoreOpener-e8d74bc0fb5ce674b95adc8cb94da50a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8d74bc0fb5ce674b95adc8cb94da50a columnFamilyName family1 2023-04-09 15:55:15,060 INFO [StoreOpener-e8d74bc0fb5ce674b95adc8cb94da50a-1] regionserver.HStore(310): Store=e8d74bc0fb5ce674b95adc8cb94da50a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:15,060 INFO [StoreOpener-e8d74bc0fb5ce674b95adc8cb94da50a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e8d74bc0fb5ce674b95adc8cb94da50a 2023-04-09 15:55:15,061 DEBUG [StoreOpener-e8d74bc0fb5ce674b95adc8cb94da50a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2 2023-04-09 15:55:15,061 DEBUG [StoreOpener-e8d74bc0fb5ce674b95adc8cb94da50a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2 2023-04-09 15:55:15,061 INFO [StoreOpener-e8d74bc0fb5ce674b95adc8cb94da50a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8d74bc0fb5ce674b95adc8cb94da50a columnFamilyName family2 2023-04-09 15:55:15,062 INFO [StoreOpener-e8d74bc0fb5ce674b95adc8cb94da50a-1] regionserver.HStore(310): Store=e8d74bc0fb5ce674b95adc8cb94da50a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:15,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a 2023-04-09 15:55:15,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a 2023-04-09 15:55:15,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-09 15:55:15,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e8d74bc0fb5ce674b95adc8cb94da50a 2023-04-09 15:55:15,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:55:15,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e8d74bc0fb5ce674b95adc8cb94da50a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62443923, jitterRate=-0.06951303780078888}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-09 15:55:15,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e8d74bc0fb5ce674b95adc8cb94da50a: 2023-04-09 15:55:15,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a., pid=109, masterSystemTime=1681055715053 2023-04-09 15:55:15,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:15,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:15,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:15,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ffe3cc2905f4a676202562918179e075, NAME => 'ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075.', STARTKEY => '1', ENDKEY => '2'} 2023-04-09 15:55:15,069 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e8d74bc0fb5ce674b95adc8cb94da50a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:15,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction ffe3cc2905f4a676202562918179e075 2023-04-09 15:55:15,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:55:15,069 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1681055715069"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055715069"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055715069"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055715069"}]},"ts":"1681055715069"} 2023-04-09 15:55:15,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ffe3cc2905f4a676202562918179e075 2023-04-09 15:55:15,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ffe3cc2905f4a676202562918179e075 2023-04-09 15:55:15,070 INFO [StoreOpener-ffe3cc2905f4a676202562918179e075-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ffe3cc2905f4a676202562918179e075 2023-04-09 15:55:15,071 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-04-09 15:55:15,071 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure e8d74bc0fb5ce674b95adc8cb94da50a, server=jenkins-hbase4.apache.org,44869,1681055618167 in 168 msec 2023-04-09 15:55:15,071 DEBUG [StoreOpener-ffe3cc2905f4a676202562918179e075-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1 2023-04-09 15:55:15,071 DEBUG [StoreOpener-ffe3cc2905f4a676202562918179e075-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1 2023-04-09 15:55:15,071 INFO [StoreOpener-ffe3cc2905f4a676202562918179e075-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ffe3cc2905f4a676202562918179e075 columnFamilyName family1 2023-04-09 15:55:15,072 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=e8d74bc0fb5ce674b95adc8cb94da50a, ASSIGN in 325 msec 2023-04-09 15:55:15,072 INFO [StoreOpener-ffe3cc2905f4a676202562918179e075-1] regionserver.HStore(310): Store=ffe3cc2905f4a676202562918179e075/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:15,072 INFO [StoreOpener-ffe3cc2905f4a676202562918179e075-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ffe3cc2905f4a676202562918179e075 2023-04-09 15:55:15,073 DEBUG [StoreOpener-ffe3cc2905f4a676202562918179e075-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2 2023-04-09 15:55:15,073 DEBUG [StoreOpener-ffe3cc2905f4a676202562918179e075-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2 2023-04-09 15:55:15,074 INFO [StoreOpener-ffe3cc2905f4a676202562918179e075-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ffe3cc2905f4a676202562918179e075 columnFamilyName family2 2023-04-09 15:55:15,074 INFO [StoreOpener-ffe3cc2905f4a676202562918179e075-1] regionserver.HStore(310): Store=ffe3cc2905f4a676202562918179e075/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:15,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075 2023-04-09 15:55:15,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075 2023-04-09 15:55:15,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-09 15:55:15,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ffe3cc2905f4a676202562918179e075 2023-04-09 15:55:15,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:55:15,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ffe3cc2905f4a676202562918179e075; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60805113, jitterRate=-0.09393320977687836}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-09 15:55:15,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ffe3cc2905f4a676202562918179e075: 2023-04-09 15:55:15,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075., pid=111, masterSystemTime=1681055715053 2023-04-09 15:55:15,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:15,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:15,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:15,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ff29b220fa2e52fe8f06bb62f0a0c261, NAME => 'ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261.', STARTKEY => '2', ENDKEY => ''} 2023-04-09 15:55:15,080 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=ffe3cc2905f4a676202562918179e075, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:15,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction ff29b220fa2e52fe8f06bb62f0a0c261 2023-04-09 15:55:15,081 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1681055715080"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055715080"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055715080"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055715080"}]},"ts":"1681055715080"} 2023-04-09 15:55:15,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:55:15,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ff29b220fa2e52fe8f06bb62f0a0c261 2023-04-09 15:55:15,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ff29b220fa2e52fe8f06bb62f0a0c261 2023-04-09 15:55:15,081 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family1/7e4b1853835a40e2b5210c49ddef3b30 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/7e4b1853835a40e2b5210c49ddef3b30 2023-04-09 15:55:15,082 INFO [StoreOpener-ff29b220fa2e52fe8f06bb62f0a0c261-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ff29b220fa2e52fe8f06bb62f0a0c261 2023-04-09 15:55:15,083 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=107 2023-04-09 15:55:15,083 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure ffe3cc2905f4a676202562918179e075, server=jenkins-hbase4.apache.org,44869,1681055618167 in 179 msec 2023-04-09 15:55:15,083 DEBUG [StoreOpener-ff29b220fa2e52fe8f06bb62f0a0c261-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1 2023-04-09 15:55:15,083 DEBUG [StoreOpener-ff29b220fa2e52fe8f06bb62f0a0c261-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1 2023-04-09 15:55:15,083 INFO [StoreOpener-ff29b220fa2e52fe8f06bb62f0a0c261-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff29b220fa2e52fe8f06bb62f0a0c261 columnFamilyName family1 2023-04-09 15:55:15,084 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ffe3cc2905f4a676202562918179e075, ASSIGN in 337 msec 2023-04-09 15:55:15,084 INFO [StoreOpener-ff29b220fa2e52fe8f06bb62f0a0c261-1] regionserver.HStore(310): Store=ff29b220fa2e52fe8f06bb62f0a0c261/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:15,084 INFO [StoreOpener-ff29b220fa2e52fe8f06bb62f0a0c261-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ff29b220fa2e52fe8f06bb62f0a0c261 2023-04-09 15:55:15,085 DEBUG [StoreOpener-ff29b220fa2e52fe8f06bb62f0a0c261-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2 2023-04-09 15:55:15,085 DEBUG [StoreOpener-ff29b220fa2e52fe8f06bb62f0a0c261-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2 2023-04-09 15:55:15,085 INFO [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 5edb26c74099296449ac252e8aa24185/family1 of 5edb26c74099296449ac252e8aa24185 into 7e4b1853835a40e2b5210c49ddef3b30(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-09 15:55:15,085 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5edb26c74099296449ac252e8aa24185: 2023-04-09 15:55:15,085 INFO [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1681055713391; duration=1sec 2023-04-09 15:55:15,085 INFO [StoreOpener-ff29b220fa2e52fe8f06bb62f0a0c261-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff29b220fa2e52fe8f06bb62f0a0c261 columnFamilyName family2 2023-04-09 15:55:15,085 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-04-09 15:55:15,086 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-04-09 15:55:15,086 INFO [StoreOpener-ff29b220fa2e52fe8f06bb62f0a0c261-1] regionserver.HStore(310): Store=ff29b220fa2e52fe8f06bb62f0a0c261/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:15,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261 2023-04-09 15:55:15,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261 2023-04-09 15:55:15,087 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-04-09 15:55:15,088 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.HStore(1912): 2720147230b846f05cd943c11531e895/family2 is initiating minor compaction (all files) 2023-04-09 15:55:15,088 INFO [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 2720147230b846f05cd943c11531e895/family2 in testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:15,088 INFO [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-6034a543e7964a0caf90eba11d97eb06, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-27ea281ccac2403283dcc700b50f015d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-45a8253ed7304a0997bd5d42d5fe6ecf, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-8514d9964a5341a690c8eb6f47af97ba] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp, totalSize=20.4 K 2023-04-09 15:55:15,088 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-6034a543e7964a0caf90eba11d97eb06, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055695109 2023-04-09 15:55:15,089 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-27ea281ccac2403283dcc700b50f015d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055696517 2023-04-09 15:55:15,089 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-45a8253ed7304a0997bd5d42d5fe6ecf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055697967 2023-04-09 15:55:15,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-09 15:55:15,090 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-8514d9964a5341a690c8eb6f47af97ba, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055699430 2023-04-09 15:55:15,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ff29b220fa2e52fe8f06bb62f0a0c261 2023-04-09 15:55:15,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:55:15,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ff29b220fa2e52fe8f06bb62f0a0c261; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63030273, jitterRate=-0.060775741934776306}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-09 15:55:15,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ff29b220fa2e52fe8f06bb62f0a0c261: 2023-04-09 15:55:15,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261., pid=110, masterSystemTime=1681055715053 2023-04-09 15:55:15,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:15,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:15,094 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=ff29b220fa2e52fe8f06bb62f0a0c261, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:15,094 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1681055715094"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055715094"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055715094"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055715094"}]},"ts":"1681055715094"} 2023-04-09 15:55:15,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=108 2023-04-09 15:55:15,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure ff29b220fa2e52fe8f06bb62f0a0c261, server=jenkins-hbase4.apache.org,44869,1681055618167 in 193 msec 2023-04-09 15:55:15,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=105 2023-04-09 15:55:15,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ff29b220fa2e52fe8f06bb62f0a0c261, ASSIGN in 350 msec 2023-04-09 15:55:15,098 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-09 15:55:15,098 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055715098"}]},"ts":"1681055715098"} 2023-04-09 15:55:15,099 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-04-09 15:55:15,101 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-04-09 15:55:15,102 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1850 sec 2023-04-09 15:55:15,112 INFO [RS:0;jenkins-hbase4:44869-longCompactions-0] throttle.PressureAwareThroughputController(145): 2720147230b846f05cd943c11531e895#family2#compaction#118 average throughput is 0.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-04-09 15:55:15,180 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-631c4c55741a4999a4a87883f7cad6aa, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-46a363d96db148fa8e2a0428ef48e5de, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-27bfe4cf580941419fe1ee530dad30ed, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-ff23ebbd09f64cd09a309c5eacd98052, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/1b4fc67c825544378643e96ae8827bad_SeqId_34_] to archive 2023-04-09 15:55:15,181 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:15,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-631c4c55741a4999a4a87883f7cad6aa to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-631c4c55741a4999a4a87883f7cad6aa 2023-04-09 15:55:15,184 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-46a363d96db148fa8e2a0428ef48e5de to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-46a363d96db148fa8e2a0428ef48e5de 2023-04-09 15:55:15,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-27bfe4cf580941419fe1ee530dad30ed to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-27bfe4cf580941419fe1ee530dad30ed 2023-04-09 15:55:15,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-ff23ebbd09f64cd09a309c5eacd98052 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-ff23ebbd09f64cd09a309c5eacd98052 2023-04-09 15:55:15,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/1b4fc67c825544378643e96ae8827bad_SeqId_34_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family1/1b4fc67c825544378643e96ae8827bad_SeqId_34_ 2023-04-09 15:55:15,924 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/.tmp/family2/ccddb53c52ab4c71a1140e5dfd7d5098 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/ccddb53c52ab4c71a1140e5dfd7d5098 2023-04-09 15:55:15,928 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 5edb26c74099296449ac252e8aa24185/family2 of 5edb26c74099296449ac252e8aa24185 into ccddb53c52ab4c71a1140e5dfd7d5098(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-09 15:55:15,928 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5edb26c74099296449ac252e8aa24185: 2023-04-09 15:55:15,928 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185., storeName=5edb26c74099296449ac252e8aa24185/family2, priority=12, startTime=1681055712658; duration=1sec 2023-04-09 15:55:15,928 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-04-09 15:55:15,928 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-04-09 15:55:15,929 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-04-09 15:55:15,929 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-04-09 15:55:15,929 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. because compaction request was cancelled 2023-04-09 15:55:15,929 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-04-09 15:55:15,929 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-04-09 15:55:15,929 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-04-09 15:55:15,929 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. because compaction request was cancelled 2023-04-09 15:55:15,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-48c8a7dae6bf41859cf8faf76194adcf, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-7af52dc4dd584035a1cab3ea5e64325a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-72e08a32ca9a4e97840a12454ee021e6, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-9f6f733a0a1949c78db20b5e3437aba1] to archive 2023-04-09 15:55:15,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:15,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-48c8a7dae6bf41859cf8faf76194adcf to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-48c8a7dae6bf41859cf8faf76194adcf 2023-04-09 15:55:15,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-7af52dc4dd584035a1cab3ea5e64325a to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-7af52dc4dd584035a1cab3ea5e64325a 2023-04-09 15:55:15,975 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-72e08a32ca9a4e97840a12454ee021e6 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-72e08a32ca9a4e97840a12454ee021e6 2023-04-09 15:55:15,976 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-9f6f733a0a1949c78db20b5e3437aba1 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/family2/testCompactionWithHFileLink=5edb26c74099296449ac252e8aa24185-9f6f733a0a1949c78db20b5e3437aba1 2023-04-09 15:55:16,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-04-09 15:55:16,024 INFO [Listener at localhost/39283] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-04-09 15:55:16,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:16,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:16,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:16,036 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:16,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-04-09 15:55:16,041 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-04-09 15:55:16,041 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:16,041 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-04-09 15:55:16,041 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-04-09 15:55:16,041 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:16,041 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:16,044 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:16,044 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:16,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:16,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:16,044 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:16,044 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:16,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:16,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:16,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:16,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:16,045 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-04-09 15:55:16,045 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-04-09 15:55:16,045 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-04-09 15:55:16,045 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:16,045 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-04-09 15:55:16,045 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:16,045 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. started... 2023-04-09 15:55:16,047 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff29b220fa2e52fe8f06bb62f0a0c261 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-04-09 15:55:16,047 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:16,047 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. started... 2023-04-09 15:55:16,047 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing e8d74bc0fb5ce674b95adc8cb94da50a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-04-09 15:55:16,048 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-09 15:55:16,048 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:16,048 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:16,048 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. started... 2023-04-09 15:55:16,048 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing ffe3cc2905f4a676202562918179e075 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-04-09 15:55:16,062 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304095a69e1260572458d9dbb15e1b86584bd to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202304095a69e1260572458d9dbb15e1b86584bd 2023-04-09 15:55:16,062 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023040956d15593964e4751ba6bce48cf6483c8 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023040956d15593964e4751ba6bce48cf6483c8 2023-04-09 15:55:16,066 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304099c1343ca323346cc9f63b49918d686b8 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202304099c1343ca323346cc9f63b49918d686b8 2023-04-09 15:55:16,068 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family1/215bc8867a41412bb4c1f317cc357f00 2023-04-09 15:55:16,071 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family1/bf266114c9fb4498b8995bfe48e5644f 2023-04-09 15:55:16,082 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023040950ac46ea18c44d96bcb05bdfff4f61f9 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023040950ac46ea18c44d96bcb05bdfff4f61f9 2023-04-09 15:55:16,295 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-04-09 15:55:16,328 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/.tmp/family2/bce70f1304eb4acb8811c4c640571488 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/bce70f1304eb4acb8811c4c640571488 2023-04-09 15:55:16,332 INFO [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 2720147230b846f05cd943c11531e895/family2 of 2720147230b846f05cd943c11531e895 into bce70f1304eb4acb8811c4c640571488(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-09 15:55:16,332 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2720147230b846f05cd943c11531e895: 2023-04-09 15:55:16,332 INFO [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895., storeName=2720147230b846f05cd943c11531e895/family2, priority=12, startTime=1681055712718; duration=1sec 2023-04-09 15:55:16,332 DEBUG [RS:0;jenkins-hbase4:44869-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:55:16,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-6034a543e7964a0caf90eba11d97eb06, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-27ea281ccac2403283dcc700b50f015d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-45a8253ed7304a0997bd5d42d5fe6ecf, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-8514d9964a5341a690c8eb6f47af97ba] to archive 2023-04-09 15:55:16,375 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:16,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-6034a543e7964a0caf90eba11d97eb06 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-6034a543e7964a0caf90eba11d97eb06 2023-04-09 15:55:16,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-27ea281ccac2403283dcc700b50f015d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-27ea281ccac2403283dcc700b50f015d 2023-04-09 15:55:16,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-45a8253ed7304a0997bd5d42d5fe6ecf to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-45a8253ed7304a0997bd5d42d5fe6ecf 2023-04-09 15:55:16,379 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-8514d9964a5341a690c8eb6f47af97ba to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/family2/testCompactionWithHFileLink=2720147230b846f05cd943c11531e895-8514d9964a5341a690c8eb6f47af97ba 2023-04-09 15:55:16,469 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family1/507baed77c6940bf88781e34daf06dfd 2023-04-09 15:55:16,483 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304096e5cad6b1cb447abafed5197257088ff to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202304096e5cad6b1cb447abafed5197257088ff 2023-04-09 15:55:16,489 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family2/89cb5ac5ba4c4cde9ab2e59c9802a7a6 2023-04-09 15:55:16,492 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family1/215bc8867a41412bb4c1f317cc357f00 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/215bc8867a41412bb4c1f317cc357f00 2023-04-09 15:55:16,496 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/215bc8867a41412bb4c1f317cc357f00, entries=4, sequenceid=5, filesize=5.4 K 2023-04-09 15:55:16,496 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family2/89cb5ac5ba4c4cde9ab2e59c9802a7a6 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/89cb5ac5ba4c4cde9ab2e59c9802a7a6 2023-04-09 15:55:16,500 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/89cb5ac5ba4c4cde9ab2e59c9802a7a6, entries=2, sequenceid=5, filesize=5.1 K 2023-04-09 15:55:16,500 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ff29b220fa2e52fe8f06bb62f0a0c261 in 453ms, sequenceid=5, compaction requested=false 2023-04-09 15:55:16,501 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff29b220fa2e52fe8f06bb62f0a0c261: 2023-04-09 15:55:16,501 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:16,501 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-09 15:55:16,882 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409714b781925be45138d1ee1d0ec427145 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230409714b781925be45138d1ee1d0ec427145 2023-04-09 15:55:16,887 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family2/86b199a5f9c74a5c9881237d8e3b3239 2023-04-09 15:55:16,891 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family1/bf266114c9fb4498b8995bfe48e5644f as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/bf266114c9fb4498b8995bfe48e5644f 2023-04-09 15:55:16,894 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/bf266114c9fb4498b8995bfe48e5644f, entries=4, sequenceid=5, filesize=5.4 K 2023-04-09 15:55:16,895 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family2/86b199a5f9c74a5c9881237d8e3b3239 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/86b199a5f9c74a5c9881237d8e3b3239 2023-04-09 15:55:16,898 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/86b199a5f9c74a5c9881237d8e3b3239, entries=2, sequenceid=5, filesize=5.1 K 2023-04-09 15:55:16,899 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ffe3cc2905f4a676202562918179e075 in 851ms, sequenceid=5, compaction requested=false 2023-04-09 15:55:16,899 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for ffe3cc2905f4a676202562918179e075: 2023-04-09 15:55:16,899 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:16,899 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-09 15:55:17,286 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family2/65f634d551534556b24c68af4821f869 2023-04-09 15:55:17,290 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family1/507baed77c6940bf88781e34daf06dfd as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/507baed77c6940bf88781e34daf06dfd 2023-04-09 15:55:17,293 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/507baed77c6940bf88781e34daf06dfd, entries=4, sequenceid=5, filesize=5.4 K 2023-04-09 15:55:17,293 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family2/65f634d551534556b24c68af4821f869 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/65f634d551534556b24c68af4821f869 2023-04-09 15:55:17,296 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/65f634d551534556b24c68af4821f869, entries=2, sequenceid=5, filesize=5.1 K 2023-04-09 15:55:17,297 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for e8d74bc0fb5ce674b95adc8cb94da50a in 1250ms, sequenceid=5, compaction requested=false 2023-04-09 15:55:17,297 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for e8d74bc0fb5ce674b95adc8cb94da50a: 2023-04-09 15:55:17,297 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:17,297 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-09 15:55:17,297 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-09 15:55:17,297 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:17,297 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-04-09 15:55:17,297 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-04-09 15:55:17,298 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:17,298 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:17,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:17,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:17,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:17,299 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:17,299 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:17,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:17,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:17,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:17,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:17,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:17,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-04-09 15:55:17,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59314f8c[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:17,300 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-04-09 15:55:17,300 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:17,301 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:17,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:17,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:17,301 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-04-09 15:55:17,301 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-04-09 15:55:17,301 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:17,301 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:17,301 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:17,302 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-04-09 15:55:17,302 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:17,302 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:17,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:17,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:17,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:17,302 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-04-09 15:55:17,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:17,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:17,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:17,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:17,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:17,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:17,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:17,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:17,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-04-09 15:55:17,304 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-04-09 15:55:17,304 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:17,304 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:17,304 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-04-09 15:55:17,304 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:17,307 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:17,307 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:17,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:17,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:17,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:17,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:17,307 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:17,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:17,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:17,307 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:17,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:17,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:17,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:17,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:17,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:17,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:17,308 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:17,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:17,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:17,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:17,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:17,310 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:17,310 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:17,310 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:17,310 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:17,310 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:17,310 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:17,310 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:17,310 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-04-09 15:55:17,311 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:17,310 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:17,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-04-09 15:55:17,311 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:17,311 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:17,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:17,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:17,311 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:17,311 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:17,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:17,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:17,411 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:17,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:17,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:17,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:17,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:17,416 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:17,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-04-09 15:55:17,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-04-09 15:55:17,418 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-04-09 15:55:17,418 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:17,418 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-04-09 15:55:17,418 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-04-09 15:55:17,418 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:17,418 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:17,419 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:17,419 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:17,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:17,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:17,420 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:17,420 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:17,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:17,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:17,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:17,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:17,420 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-04-09 15:55:17,421 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-04-09 15:55:17,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-04-09 15:55:17,421 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-04-09 15:55:17,421 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:17,421 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-04-09 15:55:17,421 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:17,421 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. started... 2023-04-09 15:55:17,421 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:17,421 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-09 15:55:17,421 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:17,421 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff29b220fa2e52fe8f06bb62f0a0c261 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-04-09 15:55:17,421 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. started... 2023-04-09 15:55:17,421 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. started... 2023-04-09 15:55:17,421 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:17,421 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing ffe3cc2905f4a676202562918179e075 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-04-09 15:55:17,421 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing e8d74bc0fb5ce674b95adc8cb94da50a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-04-09 15:55:17,832 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304099fd8378fad284363abb67b7210ae4a7c to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202304099fd8378fad284363abb67b7210ae4a7c 2023-04-09 15:55:17,833 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230409c09a28694ea3468dbe26d911cfb9ae57 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230409c09a28694ea3468dbe26d911cfb9ae57 2023-04-09 15:55:17,833 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304092ced8e7b3a8c4e31b92f4552fa4e38ff to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202304092ced8e7b3a8c4e31b92f4552fa4e38ff 2023-04-09 15:55:18,237 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family1/e3d5c4cb2d8b4188be1c5990e8c64631 2023-04-09 15:55:18,238 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family1/da21b23ec21342e88d0aa5d60923209b 2023-04-09 15:55:18,238 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family1/ac2ebb5420334263b6206899b25c7e16 2023-04-09 15:55:18,256 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230409f710c2118277449284e748f78db509db to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230409f710c2118277449284e748f78db509db 2023-04-09 15:55:18,653 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023040994dec85722054a109e62341dc07c3822 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023040994dec85722054a109e62341dc07c3822 2023-04-09 15:55:18,657 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304093440f56c51e740a7bc14be44768354db to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202304093440f56c51e740a7bc14be44768354db 2023-04-09 15:55:18,658 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family2/6e8d994fc5dc4a12bb509feb486b341a 2023-04-09 15:55:18,661 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family2/79ae9f132fe142c49d49d7af35dc6034 2023-04-09 15:55:18,663 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family1/ac2ebb5420334263b6206899b25c7e16 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/ac2ebb5420334263b6206899b25c7e16 2023-04-09 15:55:18,665 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family1/da21b23ec21342e88d0aa5d60923209b as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/da21b23ec21342e88d0aa5d60923209b 2023-04-09 15:55:18,666 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/ac2ebb5420334263b6206899b25c7e16, entries=4, sequenceid=9, filesize=5.4 K 2023-04-09 15:55:18,667 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family2/6e8d994fc5dc4a12bb509feb486b341a as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/6e8d994fc5dc4a12bb509feb486b341a 2023-04-09 15:55:18,669 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/da21b23ec21342e88d0aa5d60923209b, entries=4, sequenceid=9, filesize=5.4 K 2023-04-09 15:55:18,669 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family2/79ae9f132fe142c49d49d7af35dc6034 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/79ae9f132fe142c49d49d7af35dc6034 2023-04-09 15:55:18,670 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/6e8d994fc5dc4a12bb509feb486b341a, entries=2, sequenceid=9, filesize=5.1 K 2023-04-09 15:55:18,671 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ff29b220fa2e52fe8f06bb62f0a0c261 in 1250ms, sequenceid=9, compaction requested=false 2023-04-09 15:55:18,671 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff29b220fa2e52fe8f06bb62f0a0c261: 2023-04-09 15:55:18,671 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:18,671 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-09 15:55:18,672 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/79ae9f132fe142c49d49d7af35dc6034, entries=2, sequenceid=9, filesize=5.1 K 2023-04-09 15:55:18,673 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ffe3cc2905f4a676202562918179e075 in 1252ms, sequenceid=9, compaction requested=false 2023-04-09 15:55:18,673 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for ffe3cc2905f4a676202562918179e075: 2023-04-09 15:55:18,673 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:18,673 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-09 15:55:19,063 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family2/89a4001beacb4c83af8f2aab098e07db 2023-04-09 15:55:19,066 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family1/e3d5c4cb2d8b4188be1c5990e8c64631 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/e3d5c4cb2d8b4188be1c5990e8c64631 2023-04-09 15:55:19,069 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/e3d5c4cb2d8b4188be1c5990e8c64631, entries=4, sequenceid=9, filesize=5.4 K 2023-04-09 15:55:19,070 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family2/89a4001beacb4c83af8f2aab098e07db as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/89a4001beacb4c83af8f2aab098e07db 2023-04-09 15:55:19,073 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/89a4001beacb4c83af8f2aab098e07db, entries=2, sequenceid=9, filesize=5.1 K 2023-04-09 15:55:19,073 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for e8d74bc0fb5ce674b95adc8cb94da50a in 1652ms, sequenceid=9, compaction requested=false 2023-04-09 15:55:19,074 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for e8d74bc0fb5ce674b95adc8cb94da50a: 2023-04-09 15:55:19,074 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-09 15:55:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-09 15:55:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-04-09 15:55:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-04-09 15:55:19,075 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:19,075 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:19,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:19,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:19,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:19,075 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:19,076 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:19,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:19,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:19,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:19,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:19,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:19,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-04-09 15:55:19,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ae97966[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:19,077 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-04-09 15:55:19,077 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:19,079 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:19,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:19,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:19,079 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-04-09 15:55:19,079 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-04-09 15:55:19,079 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:19,079 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:19,079 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:19,083 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:19,083 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-04-09 15:55:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:19,083 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:19,083 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-04-09 15:55:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:19,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:19,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:19,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:19,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:19,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:19,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:19,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:19,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-04-09 15:55:19,085 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-04-09 15:55:19,085 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:19,085 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:19,085 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-04-09 15:55:19,085 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:19,086 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:19,086 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:19,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:19,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:19,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:19,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:19,086 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:19,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:19,087 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:19,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:19,088 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:19,089 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:19,089 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:19,089 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:19,089 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:19,090 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:19,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-04-09 15:55:19,090 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-04-09 15:55:19,090 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:19,090 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:19,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:19,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:19,090 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:19,090 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:19,090 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:19,090 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:19,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:19,090 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:19,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:19,090 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:19,190 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:19,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:19,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:19,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:19,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:19,194 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:19,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-04-09 15:55:19,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-04-09 15:55:19,196 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-04-09 15:55:19,196 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:19,196 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-04-09 15:55:19,196 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-04-09 15:55:19,197 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:19,197 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:19,200 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:19,201 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:19,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:19,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:19,201 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:19,201 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:19,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:19,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:19,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:19,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:19,202 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-04-09 15:55:19,202 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-04-09 15:55:19,202 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-04-09 15:55:19,202 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-04-09 15:55:19,202 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:19,202 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-04-09 15:55:19,202 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:19,202 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. started... 2023-04-09 15:55:19,202 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-09 15:55:19,202 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:19,202 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:19,202 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. started... 2023-04-09 15:55:19,202 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:19,203 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing ffe3cc2905f4a676202562918179e075 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-04-09 15:55:19,202 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff29b220fa2e52fe8f06bb62f0a0c261 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-04-09 15:55:19,203 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. started... 2023-04-09 15:55:19,203 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing e8d74bc0fb5ce674b95adc8cb94da50a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-04-09 15:55:19,614 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023040911e2597e43784f5d9a383d030149bb55 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023040911e2597e43784f5d9a383d030149bb55 2023-04-09 15:55:19,614 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304090b5dbcad8e0b45059a85702362281e2d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202304090b5dbcad8e0b45059a85702362281e2d 2023-04-09 15:55:19,614 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409723308e37cfe4082ac132914287ef308 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230409723308e37cfe4082ac132914287ef308 2023-04-09 15:55:20,023 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family1/4b0ec0561d70412894aa288854361b00 2023-04-09 15:55:20,023 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family1/32289a43431c42cfa77e4f32c6a992a0 2023-04-09 15:55:20,024 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family1/609bcab21235433c9cbcb5f3a3db509b 2023-04-09 15:55:20,448 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304097cf8e8b6349342d390c0934dbaf9e4e3 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202304097cf8e8b6349342d390c0934dbaf9e4e3 2023-04-09 15:55:20,455 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family2/721ccd40e70c456ca686cc3d6956577a 2023-04-09 15:55:20,457 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304091321836bd9ac4de7a58ee2f914c7b192 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202304091321836bd9ac4de7a58ee2f914c7b192 2023-04-09 15:55:20,458 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023040930eb15ba92e54466beba61745e289ba9 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023040930eb15ba92e54466beba61745e289ba9 2023-04-09 15:55:20,460 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family1/32289a43431c42cfa77e4f32c6a992a0 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/32289a43431c42cfa77e4f32c6a992a0 2023-04-09 15:55:20,464 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family2/3b55a01917b14ed09c24ba325d94d64c 2023-04-09 15:55:20,465 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/32289a43431c42cfa77e4f32c6a992a0, entries=4, sequenceid=13, filesize=5.4 K 2023-04-09 15:55:20,467 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family2/729c5ed8c9dc414597e9432e3926bbc3 2023-04-09 15:55:20,467 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family2/721ccd40e70c456ca686cc3d6956577a as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/721ccd40e70c456ca686cc3d6956577a 2023-04-09 15:55:20,470 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family1/609bcab21235433c9cbcb5f3a3db509b as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/609bcab21235433c9cbcb5f3a3db509b 2023-04-09 15:55:20,473 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/721ccd40e70c456ca686cc3d6956577a, entries=2, sequenceid=13, filesize=5.1 K 2023-04-09 15:55:20,473 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family1/4b0ec0561d70412894aa288854361b00 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/4b0ec0561d70412894aa288854361b00 2023-04-09 15:55:20,474 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ffe3cc2905f4a676202562918179e075 in 1271ms, sequenceid=13, compaction requested=true 2023-04-09 15:55:20,474 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for ffe3cc2905f4a676202562918179e075: 2023-04-09 15:55:20,474 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:20,474 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-09 15:55:20,478 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/609bcab21235433c9cbcb5f3a3db509b, entries=4, sequenceid=13, filesize=5.4 K 2023-04-09 15:55:20,479 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/4b0ec0561d70412894aa288854361b00, entries=4, sequenceid=13, filesize=5.4 K 2023-04-09 15:55:20,480 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family2/3b55a01917b14ed09c24ba325d94d64c as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/3b55a01917b14ed09c24ba325d94d64c 2023-04-09 15:55:20,481 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family2/729c5ed8c9dc414597e9432e3926bbc3 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/729c5ed8c9dc414597e9432e3926bbc3 2023-04-09 15:55:20,490 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/3b55a01917b14ed09c24ba325d94d64c, entries=2, sequenceid=13, filesize=5.1 K 2023-04-09 15:55:20,490 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for e8d74bc0fb5ce674b95adc8cb94da50a in 1287ms, sequenceid=13, compaction requested=true 2023-04-09 15:55:20,490 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for e8d74bc0fb5ce674b95adc8cb94da50a: 2023-04-09 15:55:20,490 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:20,490 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-09 15:55:20,493 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/729c5ed8c9dc414597e9432e3926bbc3, entries=2, sequenceid=13, filesize=5.1 K 2023-04-09 15:55:20,494 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ff29b220fa2e52fe8f06bb62f0a0c261 in 1292ms, sequenceid=13, compaction requested=true 2023-04-09 15:55:20,494 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff29b220fa2e52fe8f06bb62f0a0c261: 2023-04-09 15:55:20,494 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:20,494 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-09 15:55:20,494 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-09 15:55:20,494 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:20,494 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-04-09 15:55:20,494 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-04-09 15:55:20,496 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:20,496 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:20,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:20,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:20,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:20,496 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:20,496 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:20,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:20,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:20,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:20,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:20,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:20,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-04-09 15:55:20,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46a39905[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:20,498 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-04-09 15:55:20,498 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:20,499 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:20,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:20,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:20,499 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-04-09 15:55:20,499 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-04-09 15:55:20,499 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:20,499 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:20,499 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:20,500 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:20,500 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-04-09 15:55:20,500 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:20,500 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-04-09 15:55:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:20,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:20,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:20,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:20,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:20,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:20,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:20,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:20,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:20,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-04-09 15:55:20,503 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-04-09 15:55:20,503 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:20,503 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:20,503 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-04-09 15:55:20,503 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:20,511 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:20,511 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:20,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:20,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:20,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:20,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:20,511 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:20,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:20,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:20,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:20,511 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:20,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:20,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:20,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:20,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:20,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:20,513 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:20,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:20,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:20,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:20,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:20,515 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:20,515 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:20,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:20,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:20,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:20,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:20,516 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:20,516 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-04-09 15:55:20,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-04-09 15:55:20,516 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:20,516 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:20,516 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:20,516 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:20,516 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:20,516 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:20,516 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:20,516 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:20,516 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:20,517 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:20,558 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-09 15:55:20,617 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:20,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:20,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:20,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:20,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:20,621 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:20,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-04-09 15:55:20,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-04-09 15:55:20,623 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-04-09 15:55:20,623 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:20,623 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-04-09 15:55:20,623 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-04-09 15:55:20,623 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:20,623 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:20,625 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:20,625 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:20,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:20,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:20,625 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:20,625 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:20,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:20,625 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:20,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:20,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:20,626 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-04-09 15:55:20,626 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-04-09 15:55:20,626 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-04-09 15:55:20,626 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-04-09 15:55:20,626 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:20,626 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-04-09 15:55:20,626 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:20,626 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. started... 2023-04-09 15:55:20,626 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff29b220fa2e52fe8f06bb62f0a0c261 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-04-09 15:55:20,628 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:20,628 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. started... 2023-04-09 15:55:20,628 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing e8d74bc0fb5ce674b95adc8cb94da50a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-04-09 15:55:20,634 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-09 15:55:20,635 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:20,635 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:20,635 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. started... 2023-04-09 15:55:20,635 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing ffe3cc2905f4a676202562918179e075 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-04-09 15:55:21,065 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023040947c3ff5c4dc34614971bfd5a8773f04d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023040947c3ff5c4dc34614971bfd5a8773f04d 2023-04-09 15:55:21,069 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409b8ba36b6aa02416cb386643f8dfdf577 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230409b8ba36b6aa02416cb386643f8dfdf577 2023-04-09 15:55:21,072 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family1/4ceff14d528d4954a040b2f912415a49 2023-04-09 15:55:21,075 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family1/ee710e72e278445595a29fd0b443f967 2023-04-09 15:55:21,085 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230409dd508d53723c48f28343659bb090e7f5 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230409dd508d53723c48f28343659bb090e7f5 2023-04-09 15:55:21,089 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409190da27b86bf44a69c5b2a1139a4e7f6 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230409190da27b86bf44a69c5b2a1139a4e7f6 2023-04-09 15:55:21,490 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family1/15a44d2298864773946220e4145f4478 2023-04-09 15:55:21,494 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family2/cf457e03c057438cbb68b2a496daf366 2023-04-09 15:55:21,495 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409b3ba1665ecbf4ee1926a1141595190c4 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230409b3ba1665ecbf4ee1926a1141595190c4 2023-04-09 15:55:21,499 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family1/4ceff14d528d4954a040b2f912415a49 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/4ceff14d528d4954a040b2f912415a49 2023-04-09 15:55:21,505 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family2/c552f20e47bf4ee3bf75e1c903518348 2023-04-09 15:55:21,507 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/4ceff14d528d4954a040b2f912415a49, entries=4, sequenceid=17, filesize=5.4 K 2023-04-09 15:55:21,508 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family2/cf457e03c057438cbb68b2a496daf366 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/cf457e03c057438cbb68b2a496daf366 2023-04-09 15:55:21,510 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family1/ee710e72e278445595a29fd0b443f967 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/ee710e72e278445595a29fd0b443f967 2023-04-09 15:55:21,512 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/cf457e03c057438cbb68b2a496daf366, entries=2, sequenceid=17, filesize=5.1 K 2023-04-09 15:55:21,513 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for e8d74bc0fb5ce674b95adc8cb94da50a in 885ms, sequenceid=17, compaction requested=true 2023-04-09 15:55:21,513 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for e8d74bc0fb5ce674b95adc8cb94da50a: 2023-04-09 15:55:21,513 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:21,514 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-09 15:55:21,515 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/ee710e72e278445595a29fd0b443f967, entries=4, sequenceid=17, filesize=5.4 K 2023-04-09 15:55:21,515 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family2/c552f20e47bf4ee3bf75e1c903518348 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/c552f20e47bf4ee3bf75e1c903518348 2023-04-09 15:55:21,526 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/c552f20e47bf4ee3bf75e1c903518348, entries=2, sequenceid=17, filesize=5.1 K 2023-04-09 15:55:21,527 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ff29b220fa2e52fe8f06bb62f0a0c261 in 901ms, sequenceid=17, compaction requested=true 2023-04-09 15:55:21,527 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff29b220fa2e52fe8f06bb62f0a0c261: 2023-04-09 15:55:21,527 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:21,527 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-09 15:55:21,913 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304094b86676a4e3c4566bfb3570f16b71324 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202304094b86676a4e3c4566bfb3570f16b71324 2023-04-09 15:55:22,318 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family2/ac406917fed44d81aa92bdcdb30a1cbe 2023-04-09 15:55:22,332 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family1/15a44d2298864773946220e4145f4478 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/15a44d2298864773946220e4145f4478 2023-04-09 15:55:22,336 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/15a44d2298864773946220e4145f4478, entries=4, sequenceid=17, filesize=5.4 K 2023-04-09 15:55:22,337 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family2/ac406917fed44d81aa92bdcdb30a1cbe as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/ac406917fed44d81aa92bdcdb30a1cbe 2023-04-09 15:55:22,345 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/ac406917fed44d81aa92bdcdb30a1cbe, entries=2, sequenceid=17, filesize=5.1 K 2023-04-09 15:55:22,346 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ffe3cc2905f4a676202562918179e075 in 1711ms, sequenceid=17, compaction requested=true 2023-04-09 15:55:22,346 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for ffe3cc2905f4a676202562918179e075: 2023-04-09 15:55:22,346 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:22,346 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-09 15:55:22,346 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-09 15:55:22,346 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:22,346 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-04-09 15:55:22,346 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-04-09 15:55:22,348 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:22,348 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:22,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:22,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:22,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:22,349 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:22,349 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:22,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:22,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:22,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:22,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:22,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:22,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-04-09 15:55:22,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5715066a[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:22,351 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-04-09 15:55:22,351 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:22,352 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:22,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:22,352 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-04-09 15:55:22,352 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-04-09 15:55:22,352 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:22,352 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:22,352 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:22,355 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-04-09 15:55:22,355 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:22,355 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:22,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:22,355 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-04-09 15:55:22,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:22,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:22,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:22,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:22,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:22,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:22,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:22,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:22,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:22,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:22,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-04-09 15:55:22,358 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-04-09 15:55:22,358 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:22,358 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:22,359 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-04-09 15:55:22,359 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:22,360 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:22,360 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:22,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:22,360 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:22,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:22,361 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:22,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:22,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:22,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:22,362 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:22,365 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:22,365 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:22,365 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:22,365 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:22,365 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-04-09 15:55:22,365 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:22,365 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:22,365 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:22,365 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:22,366 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:22,366 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:22,365 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:22,365 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:22,366 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:22,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:22,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:22,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:22,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:22,466 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:22,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:22,479 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:22,491 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:22,504 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:22,512 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:22,540 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:22,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-04-09 15:55:22,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-04-09 15:55:22,542 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-04-09 15:55:22,542 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:22,542 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-04-09 15:55:22,542 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-04-09 15:55:22,543 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:22,543 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:22,544 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:22,544 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:22,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:22,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:22,544 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:22,544 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:22,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:22,545 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:22,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:22,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:22,545 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-04-09 15:55:22,546 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-04-09 15:55:22,546 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-04-09 15:55:22,546 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-04-09 15:55:22,546 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:22,546 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-04-09 15:55:22,546 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:22,546 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. started... 2023-04-09 15:55:22,546 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-09 15:55:22,546 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:22,546 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff29b220fa2e52fe8f06bb62f0a0c261 2/2 column families, dataSize=138 B heapSize=944 B 2023-04-09 15:55:22,546 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:22,546 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:22,546 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. started... 2023-04-09 15:55:22,547 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. started... 2023-04-09 15:55:22,547 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing ffe3cc2905f4a676202562918179e075 2/2 column families, dataSize=138 B heapSize=944 B 2023-04-09 15:55:22,547 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing e8d74bc0fb5ce674b95adc8cb94da50a 2/2 column families, dataSize=138 B heapSize=944 B 2023-04-09 15:55:22,982 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family1/dd73888b9713401b98a77635f52390f2 2023-04-09 15:55:22,982 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family1/81ef56517e2c479ebc50d5d007d90a11 2023-04-09 15:55:22,984 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family1/2cf9a8bd6a9c40338063bc7154b6573d 2023-04-09 15:55:22,987 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81ef56517e2c479ebc50d5d007d90a11 2023-04-09 15:55:22,987 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd73888b9713401b98a77635f52390f2 2023-04-09 15:55:22,990 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cf9a8bd6a9c40338063bc7154b6573d 2023-04-09 15:55:23,035 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family2/538a1b99264b42f48490f0eaa46fe201 2023-04-09 15:55:23,039 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 538a1b99264b42f48490f0eaa46fe201 2023-04-09 15:55:23,040 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family1/2cf9a8bd6a9c40338063bc7154b6573d as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/2cf9a8bd6a9c40338063bc7154b6573d 2023-04-09 15:55:23,045 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cf9a8bd6a9c40338063bc7154b6573d 2023-04-09 15:55:23,045 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/2cf9a8bd6a9c40338063bc7154b6573d, entries=3, sequenceid=23, filesize=5.0 K 2023-04-09 15:55:23,046 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family2/538a1b99264b42f48490f0eaa46fe201 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/538a1b99264b42f48490f0eaa46fe201 2023-04-09 15:55:23,050 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 538a1b99264b42f48490f0eaa46fe201 2023-04-09 15:55:23,050 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/538a1b99264b42f48490f0eaa46fe201, entries=1, sequenceid=23, filesize=5.0 K 2023-04-09 15:55:23,051 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ffe3cc2905f4a676202562918179e075 in 504ms, sequenceid=23, compaction requested=true 2023-04-09 15:55:23,051 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for ffe3cc2905f4a676202562918179e075: 2023-04-09 15:55:23,051 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:23,051 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-09 15:55:23,432 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family2/f41b2ec1f77743458710556d5d193068 2023-04-09 15:55:23,436 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f41b2ec1f77743458710556d5d193068 2023-04-09 15:55:23,437 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family1/dd73888b9713401b98a77635f52390f2 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/dd73888b9713401b98a77635f52390f2 2023-04-09 15:55:23,440 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd73888b9713401b98a77635f52390f2 2023-04-09 15:55:23,440 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/dd73888b9713401b98a77635f52390f2, entries=3, sequenceid=23, filesize=5.0 K 2023-04-09 15:55:23,441 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family2/f41b2ec1f77743458710556d5d193068 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/f41b2ec1f77743458710556d5d193068 2023-04-09 15:55:23,444 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f41b2ec1f77743458710556d5d193068 2023-04-09 15:55:23,445 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/f41b2ec1f77743458710556d5d193068, entries=1, sequenceid=23, filesize=5.0 K 2023-04-09 15:55:23,445 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for e8d74bc0fb5ce674b95adc8cb94da50a in 898ms, sequenceid=23, compaction requested=true 2023-04-09 15:55:23,445 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for e8d74bc0fb5ce674b95adc8cb94da50a: 2023-04-09 15:55:23,445 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:23,446 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-09 15:55:23,833 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family2/5ff3e6ddc43e41c6b9d7c0bdcac08d21 2023-04-09 15:55:23,838 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5ff3e6ddc43e41c6b9d7c0bdcac08d21 2023-04-09 15:55:23,838 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family1/81ef56517e2c479ebc50d5d007d90a11 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/81ef56517e2c479ebc50d5d007d90a11 2023-04-09 15:55:23,842 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81ef56517e2c479ebc50d5d007d90a11 2023-04-09 15:55:23,842 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/81ef56517e2c479ebc50d5d007d90a11, entries=3, sequenceid=23, filesize=5.0 K 2023-04-09 15:55:23,843 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family2/5ff3e6ddc43e41c6b9d7c0bdcac08d21 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/5ff3e6ddc43e41c6b9d7c0bdcac08d21 2023-04-09 15:55:23,847 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5ff3e6ddc43e41c6b9d7c0bdcac08d21 2023-04-09 15:55:23,847 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/5ff3e6ddc43e41c6b9d7c0bdcac08d21, entries=1, sequenceid=23, filesize=5.0 K 2023-04-09 15:55:23,848 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ff29b220fa2e52fe8f06bb62f0a0c261 in 1302ms, sequenceid=23, compaction requested=true 2023-04-09 15:55:23,848 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff29b220fa2e52fe8f06bb62f0a0c261: 2023-04-09 15:55:23,848 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:23,848 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-09 15:55:23,848 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-09 15:55:23,848 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:23,848 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-04-09 15:55:23,848 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-04-09 15:55:23,849 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:23,849 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:23,850 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:23,850 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:23,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:23,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:23,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-04-09 15:55:23,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48b7e2b[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:23,851 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-04-09 15:55:23,851 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:23,852 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:23,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:23,852 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-04-09 15:55:23,853 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-04-09 15:55:23,853 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:23,853 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:23,853 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:23,857 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-04-09 15:55:23,857 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:23,858 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-04-09 15:55:23,858 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:23,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:23,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:23,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:23,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:23,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:23,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:23,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:23,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:23,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:23,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:23,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:23,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-04-09 15:55:23,860 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-04-09 15:55:23,860 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:23,860 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:23,860 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-04-09 15:55:23,860 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:23,862 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:23,862 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:23,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:23,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:23,862 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:23,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:23,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:23,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:23,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:23,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:23,862 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:23,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:23,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:23,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:23,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:23,865 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:23,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:23,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:23,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:23,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-04-09 15:55:23,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:23,867 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:23,867 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:23,867 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-04-09 15:55:23,867 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:23,867 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:23,867 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:23,867 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:23,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:23,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:23,867 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:23,867 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-04-09 15:55:23,867 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:23,867 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:23,867 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:23,867 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-04-09 15:55:23,867 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-04-09 15:55:23,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:23,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:23,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-04-09 15:55:23,967 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:23,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:23,969 DEBUG [Listener at localhost/39283] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:23,969 DEBUG [Listener at localhost/39283] regionserver.HStore(1912): ff29b220fa2e52fe8f06bb62f0a0c261/family1 is initiating major compaction (all files) 2023-04-09 15:55:23,969 INFO [Listener at localhost/39283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:55:23,969 INFO [Listener at localhost/39283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:55:23,969 INFO [Listener at localhost/39283] regionserver.HRegion(2259): Starting compaction of ff29b220fa2e52fe8f06bb62f0a0c261/family1 in ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:23,970 INFO [Listener at localhost/39283] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/215bc8867a41412bb4c1f317cc357f00, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/ac2ebb5420334263b6206899b25c7e16, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/4b0ec0561d70412894aa288854361b00, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/ee710e72e278445595a29fd0b443f967, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/81ef56517e2c479ebc50d5d007d90a11] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp, totalSize=26.6 K 2023-04-09 15:55:23,972 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 215bc8867a41412bb4c1f317cc357f00, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055716033 2023-04-09 15:55:23,973 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting ac2ebb5420334263b6206899b25c7e16, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055717414 2023-04-09 15:55:23,974 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 4b0ec0561d70412894aa288854361b00, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055719192 2023-04-09 15:55:23,974 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting ee710e72e278445595a29fd0b443f967, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055720619 2023-04-09 15:55:23,975 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 81ef56517e2c479ebc50d5d007d90a11, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-09 15:55:23,993 INFO [Listener at localhost/39283] throttle.PressureAwareThroughputController(145): ff29b220fa2e52fe8f06bb62f0a0c261#family1#compaction#149 average throughput is 0.24 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:55:24,001 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230409932a5986c6b548e8b492ab8837e71f19_del 2023-04-09 15:55:24,002 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409932a5986c6b548e8b492ab8837e71f19_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230409932a5986c6b548e8b492ab8837e71f19_del 2023-04-09 15:55:24,819 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1e45872922346629e4b11afe34eef60 2023-04-09 15:55:24,820 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family1/a1e45872922346629e4b11afe34eef60 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/a1e45872922346629e4b11afe34eef60 2023-04-09 15:55:24,824 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1e45872922346629e4b11afe34eef60 2023-04-09 15:55:24,825 INFO [Listener at localhost/39283] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ff29b220fa2e52fe8f06bb62f0a0c261/family1 of ff29b220fa2e52fe8f06bb62f0a0c261 into a1e45872922346629e4b11afe34eef60(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:55:24,825 DEBUG [Listener at localhost/39283] regionserver.HRegion(2289): Compaction status journal for ff29b220fa2e52fe8f06bb62f0a0c261: 2023-04-09 15:55:24,826 DEBUG [Listener at localhost/39283] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:24,826 DEBUG [Listener at localhost/39283] regionserver.HStore(1912): ff29b220fa2e52fe8f06bb62f0a0c261/family2 is initiating major compaction (all files) 2023-04-09 15:55:24,826 INFO [Listener at localhost/39283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:55:24,826 INFO [Listener at localhost/39283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:55:24,826 INFO [Listener at localhost/39283] regionserver.HRegion(2259): Starting compaction of ff29b220fa2e52fe8f06bb62f0a0c261/family2 in ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:24,826 INFO [Listener at localhost/39283] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/89cb5ac5ba4c4cde9ab2e59c9802a7a6, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/6e8d994fc5dc4a12bb509feb486b341a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/729c5ed8c9dc414597e9432e3926bbc3, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/c552f20e47bf4ee3bf75e1c903518348, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/5ff3e6ddc43e41c6b9d7c0bdcac08d21] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp, totalSize=25.3 K 2023-04-09 15:55:24,827 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 89cb5ac5ba4c4cde9ab2e59c9802a7a6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055716033 2023-04-09 15:55:24,828 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 6e8d994fc5dc4a12bb509feb486b341a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055717414 2023-04-09 15:55:24,828 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 729c5ed8c9dc414597e9432e3926bbc3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055719192 2023-04-09 15:55:24,829 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting c552f20e47bf4ee3bf75e1c903518348, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055720619 2023-04-09 15:55:24,829 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 5ff3e6ddc43e41c6b9d7c0bdcac08d21, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-09 15:55:24,847 INFO [Listener at localhost/39283] throttle.PressureAwareThroughputController(145): ff29b220fa2e52fe8f06bb62f0a0c261#family2#compaction#150 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:55:24,856 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202304092a165e204c634131aaf625eeeb712b7d_del 2023-04-09 15:55:24,856 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304092a165e204c634131aaf625eeeb712b7d_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202304092a165e204c634131aaf625eeeb712b7d_del 2023-04-09 15:55:24,873 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/215bc8867a41412bb4c1f317cc357f00, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/ac2ebb5420334263b6206899b25c7e16, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/4b0ec0561d70412894aa288854361b00, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/ee710e72e278445595a29fd0b443f967, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/81ef56517e2c479ebc50d5d007d90a11] to archive 2023-04-09 15:55:24,873 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:24,875 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/215bc8867a41412bb4c1f317cc357f00 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/215bc8867a41412bb4c1f317cc357f00 2023-04-09 15:55:24,876 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/ac2ebb5420334263b6206899b25c7e16 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/ac2ebb5420334263b6206899b25c7e16 2023-04-09 15:55:24,877 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/4b0ec0561d70412894aa288854361b00 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/4b0ec0561d70412894aa288854361b00 2023-04-09 15:55:24,878 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/ee710e72e278445595a29fd0b443f967 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/ee710e72e278445595a29fd0b443f967 2023-04-09 15:55:24,879 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/81ef56517e2c479ebc50d5d007d90a11 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/81ef56517e2c479ebc50d5d007d90a11 2023-04-09 15:55:25,671 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d0c38155debd4b2eb1a637e7c9da3a1d 2023-04-09 15:55:25,672 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/.tmp/family2/d0c38155debd4b2eb1a637e7c9da3a1d as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/d0c38155debd4b2eb1a637e7c9da3a1d 2023-04-09 15:55:25,676 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d0c38155debd4b2eb1a637e7c9da3a1d 2023-04-09 15:55:25,677 INFO [Listener at localhost/39283] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ff29b220fa2e52fe8f06bb62f0a0c261/family2 of ff29b220fa2e52fe8f06bb62f0a0c261 into d0c38155debd4b2eb1a637e7c9da3a1d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:55:25,678 DEBUG [Listener at localhost/39283] regionserver.HRegion(2289): Compaction status journal for ff29b220fa2e52fe8f06bb62f0a0c261: 2023-04-09 15:55:25,678 DEBUG [Listener at localhost/39283] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:25,678 DEBUG [Listener at localhost/39283] regionserver.HStore(1912): e8d74bc0fb5ce674b95adc8cb94da50a/family1 is initiating major compaction (all files) 2023-04-09 15:55:25,678 INFO [Listener at localhost/39283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:55:25,678 INFO [Listener at localhost/39283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:55:25,679 INFO [Listener at localhost/39283] regionserver.HRegion(2259): Starting compaction of e8d74bc0fb5ce674b95adc8cb94da50a/family1 in ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:25,679 INFO [Listener at localhost/39283] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/507baed77c6940bf88781e34daf06dfd, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/e3d5c4cb2d8b4188be1c5990e8c64631, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/609bcab21235433c9cbcb5f3a3db509b, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/4ceff14d528d4954a040b2f912415a49, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/dd73888b9713401b98a77635f52390f2] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp, totalSize=26.6 K 2023-04-09 15:55:25,680 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 507baed77c6940bf88781e34daf06dfd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055716032 2023-04-09 15:55:25,680 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting e3d5c4cb2d8b4188be1c5990e8c64631, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055717414 2023-04-09 15:55:25,681 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 609bcab21235433c9cbcb5f3a3db509b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055719192 2023-04-09 15:55:25,681 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 4ceff14d528d4954a040b2f912415a49, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055720619 2023-04-09 15:55:25,682 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting dd73888b9713401b98a77635f52390f2, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-09 15:55:25,700 INFO [Listener at localhost/39283] throttle.PressureAwareThroughputController(145): e8d74bc0fb5ce674b95adc8cb94da50a#family1#compaction#151 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:55:25,713 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230409388f43a897474795866c73f29790a9e4_del 2023-04-09 15:55:25,713 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409388f43a897474795866c73f29790a9e4_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230409388f43a897474795866c73f29790a9e4_del 2023-04-09 15:55:25,733 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 225e9414a2b04b929c1d8cc836c2fe29 2023-04-09 15:55:25,736 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family1/225e9414a2b04b929c1d8cc836c2fe29 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/225e9414a2b04b929c1d8cc836c2fe29 2023-04-09 15:55:25,740 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 225e9414a2b04b929c1d8cc836c2fe29 2023-04-09 15:55:25,742 INFO [Listener at localhost/39283] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e8d74bc0fb5ce674b95adc8cb94da50a/family1 of e8d74bc0fb5ce674b95adc8cb94da50a into 225e9414a2b04b929c1d8cc836c2fe29(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:55:25,743 DEBUG [Listener at localhost/39283] regionserver.HRegion(2289): Compaction status journal for e8d74bc0fb5ce674b95adc8cb94da50a: 2023-04-09 15:55:25,743 DEBUG [Listener at localhost/39283] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:25,743 DEBUG [Listener at localhost/39283] regionserver.HStore(1912): e8d74bc0fb5ce674b95adc8cb94da50a/family2 is initiating major compaction (all files) 2023-04-09 15:55:25,743 INFO [Listener at localhost/39283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:55:25,743 INFO [Listener at localhost/39283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:55:25,744 INFO [Listener at localhost/39283] regionserver.HRegion(2259): Starting compaction of e8d74bc0fb5ce674b95adc8cb94da50a/family2 in ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:25,744 INFO [Listener at localhost/39283] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/65f634d551534556b24c68af4821f869, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/89a4001beacb4c83af8f2aab098e07db, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/3b55a01917b14ed09c24ba325d94d64c, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/cf457e03c057438cbb68b2a496daf366, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/f41b2ec1f77743458710556d5d193068] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp, totalSize=25.3 K 2023-04-09 15:55:25,745 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 65f634d551534556b24c68af4821f869, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055716032 2023-04-09 15:55:25,745 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 89a4001beacb4c83af8f2aab098e07db, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055717414 2023-04-09 15:55:25,746 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 3b55a01917b14ed09c24ba325d94d64c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055719192 2023-04-09 15:55:25,746 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting cf457e03c057438cbb68b2a496daf366, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055720619 2023-04-09 15:55:25,747 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting f41b2ec1f77743458710556d5d193068, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-09 15:55:25,767 INFO [Listener at localhost/39283] throttle.PressureAwareThroughputController(145): e8d74bc0fb5ce674b95adc8cb94da50a#family2#compaction#152 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:55:25,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/89cb5ac5ba4c4cde9ab2e59c9802a7a6, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/6e8d994fc5dc4a12bb509feb486b341a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/729c5ed8c9dc414597e9432e3926bbc3, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/c552f20e47bf4ee3bf75e1c903518348, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/5ff3e6ddc43e41c6b9d7c0bdcac08d21] to archive 2023-04-09 15:55:25,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:25,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/89cb5ac5ba4c4cde9ab2e59c9802a7a6 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/89cb5ac5ba4c4cde9ab2e59c9802a7a6 2023-04-09 15:55:25,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/6e8d994fc5dc4a12bb509feb486b341a to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/6e8d994fc5dc4a12bb509feb486b341a 2023-04-09 15:55:25,776 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/729c5ed8c9dc414597e9432e3926bbc3 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/729c5ed8c9dc414597e9432e3926bbc3 2023-04-09 15:55:25,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/c552f20e47bf4ee3bf75e1c903518348 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/c552f20e47bf4ee3bf75e1c903518348 2023-04-09 15:55:25,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/5ff3e6ddc43e41c6b9d7c0bdcac08d21 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family2/5ff3e6ddc43e41c6b9d7c0bdcac08d21 2023-04-09 15:55:25,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/507baed77c6940bf88781e34daf06dfd, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/e3d5c4cb2d8b4188be1c5990e8c64631, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/609bcab21235433c9cbcb5f3a3db509b, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/4ceff14d528d4954a040b2f912415a49, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/dd73888b9713401b98a77635f52390f2] to archive 2023-04-09 15:55:25,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:25,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/507baed77c6940bf88781e34daf06dfd to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/507baed77c6940bf88781e34daf06dfd 2023-04-09 15:55:25,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/e3d5c4cb2d8b4188be1c5990e8c64631 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/e3d5c4cb2d8b4188be1c5990e8c64631 2023-04-09 15:55:25,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/609bcab21235433c9cbcb5f3a3db509b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/609bcab21235433c9cbcb5f3a3db509b 2023-04-09 15:55:25,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/4ceff14d528d4954a040b2f912415a49 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/4ceff14d528d4954a040b2f912415a49 2023-04-09 15:55:25,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/dd73888b9713401b98a77635f52390f2 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/dd73888b9713401b98a77635f52390f2 2023-04-09 15:55:25,800 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230409ca041463c2b04f4fa5b1265ccad90131_del 2023-04-09 15:55:25,801 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409ca041463c2b04f4fa5b1265ccad90131_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230409ca041463c2b04f4fa5b1265ccad90131_del 2023-04-09 15:55:26,616 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e3b58cc833f43dda2445f3e7291cfc4 2023-04-09 15:55:26,617 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/.tmp/family2/5e3b58cc833f43dda2445f3e7291cfc4 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/5e3b58cc833f43dda2445f3e7291cfc4 2023-04-09 15:55:26,621 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e3b58cc833f43dda2445f3e7291cfc4 2023-04-09 15:55:26,622 INFO [Listener at localhost/39283] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e8d74bc0fb5ce674b95adc8cb94da50a/family2 of e8d74bc0fb5ce674b95adc8cb94da50a into 5e3b58cc833f43dda2445f3e7291cfc4(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:55:26,622 DEBUG [Listener at localhost/39283] regionserver.HRegion(2289): Compaction status journal for e8d74bc0fb5ce674b95adc8cb94da50a: 2023-04-09 15:55:26,622 DEBUG [Listener at localhost/39283] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:26,622 DEBUG [Listener at localhost/39283] regionserver.HStore(1912): ffe3cc2905f4a676202562918179e075/family1 is initiating major compaction (all files) 2023-04-09 15:55:26,622 INFO [Listener at localhost/39283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:55:26,622 INFO [Listener at localhost/39283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:55:26,623 INFO [Listener at localhost/39283] regionserver.HRegion(2259): Starting compaction of ffe3cc2905f4a676202562918179e075/family1 in ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:26,623 INFO [Listener at localhost/39283] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/bf266114c9fb4498b8995bfe48e5644f, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/da21b23ec21342e88d0aa5d60923209b, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/32289a43431c42cfa77e4f32c6a992a0, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/15a44d2298864773946220e4145f4478, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/2cf9a8bd6a9c40338063bc7154b6573d] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp, totalSize=26.6 K 2023-04-09 15:55:26,623 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting bf266114c9fb4498b8995bfe48e5644f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055716033 2023-04-09 15:55:26,623 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting da21b23ec21342e88d0aa5d60923209b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055717414 2023-04-09 15:55:26,624 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 32289a43431c42cfa77e4f32c6a992a0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055719192 2023-04-09 15:55:26,624 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 15a44d2298864773946220e4145f4478, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055720619 2023-04-09 15:55:26,624 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 2cf9a8bd6a9c40338063bc7154b6573d, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-09 15:55:26,633 INFO [Listener at localhost/39283] throttle.PressureAwareThroughputController(145): ffe3cc2905f4a676202562918179e075#family1#compaction#153 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:55:26,671 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/65f634d551534556b24c68af4821f869, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/89a4001beacb4c83af8f2aab098e07db, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/3b55a01917b14ed09c24ba325d94d64c, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/cf457e03c057438cbb68b2a496daf366, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/f41b2ec1f77743458710556d5d193068] to archive 2023-04-09 15:55:26,672 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:26,673 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/65f634d551534556b24c68af4821f869 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/65f634d551534556b24c68af4821f869 2023-04-09 15:55:26,674 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/89a4001beacb4c83af8f2aab098e07db to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/89a4001beacb4c83af8f2aab098e07db 2023-04-09 15:55:26,676 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/3b55a01917b14ed09c24ba325d94d64c to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/3b55a01917b14ed09c24ba325d94d64c 2023-04-09 15:55:26,677 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/cf457e03c057438cbb68b2a496daf366 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/cf457e03c057438cbb68b2a496daf366 2023-04-09 15:55:26,678 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/f41b2ec1f77743458710556d5d193068 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family2/f41b2ec1f77743458710556d5d193068 2023-04-09 15:55:27,041 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230409bd1f36ada9ce4f8cb18c2ab7d301b736_del 2023-04-09 15:55:27,041 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230409bd1f36ada9ce4f8cb18c2ab7d301b736_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230409bd1f36ada9ce4f8cb18c2ab7d301b736_del 2023-04-09 15:55:27,454 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 357a410296a4458e9d4fd7c4de8d142a 2023-04-09 15:55:27,455 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family1/357a410296a4458e9d4fd7c4de8d142a as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/357a410296a4458e9d4fd7c4de8d142a 2023-04-09 15:55:27,459 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 357a410296a4458e9d4fd7c4de8d142a 2023-04-09 15:55:27,460 INFO [Listener at localhost/39283] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ffe3cc2905f4a676202562918179e075/family1 of ffe3cc2905f4a676202562918179e075 into 357a410296a4458e9d4fd7c4de8d142a(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:55:27,460 DEBUG [Listener at localhost/39283] regionserver.HRegion(2289): Compaction status journal for ffe3cc2905f4a676202562918179e075: 2023-04-09 15:55:27,460 DEBUG [Listener at localhost/39283] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:27,461 DEBUG [Listener at localhost/39283] regionserver.HStore(1912): ffe3cc2905f4a676202562918179e075/family2 is initiating major compaction (all files) 2023-04-09 15:55:27,461 INFO [Listener at localhost/39283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:55:27,461 INFO [Listener at localhost/39283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:55:27,461 INFO [Listener at localhost/39283] regionserver.HRegion(2259): Starting compaction of ffe3cc2905f4a676202562918179e075/family2 in ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:27,461 INFO [Listener at localhost/39283] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/86b199a5f9c74a5c9881237d8e3b3239, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/79ae9f132fe142c49d49d7af35dc6034, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/721ccd40e70c456ca686cc3d6956577a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/ac406917fed44d81aa92bdcdb30a1cbe, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/538a1b99264b42f48490f0eaa46fe201] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp, totalSize=25.3 K 2023-04-09 15:55:27,461 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 86b199a5f9c74a5c9881237d8e3b3239, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055716033 2023-04-09 15:55:27,462 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 79ae9f132fe142c49d49d7af35dc6034, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055717414 2023-04-09 15:55:27,462 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 721ccd40e70c456ca686cc3d6956577a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055719192 2023-04-09 15:55:27,463 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting ac406917fed44d81aa92bdcdb30a1cbe, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055720619 2023-04-09 15:55:27,463 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 538a1b99264b42f48490f0eaa46fe201, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-09 15:55:27,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/bf266114c9fb4498b8995bfe48e5644f, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/da21b23ec21342e88d0aa5d60923209b, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/32289a43431c42cfa77e4f32c6a992a0, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/15a44d2298864773946220e4145f4478, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/2cf9a8bd6a9c40338063bc7154b6573d] to archive 2023-04-09 15:55:27,472 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:27,474 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/bf266114c9fb4498b8995bfe48e5644f to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/bf266114c9fb4498b8995bfe48e5644f 2023-04-09 15:55:27,478 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/da21b23ec21342e88d0aa5d60923209b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/da21b23ec21342e88d0aa5d60923209b 2023-04-09 15:55:27,479 INFO [Listener at localhost/39283] throttle.PressureAwareThroughputController(145): ffe3cc2905f4a676202562918179e075#family2#compaction#154 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:55:27,480 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/32289a43431c42cfa77e4f32c6a992a0 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/32289a43431c42cfa77e4f32c6a992a0 2023-04-09 15:55:27,483 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/15a44d2298864773946220e4145f4478 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/15a44d2298864773946220e4145f4478 2023-04-09 15:55:27,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/2cf9a8bd6a9c40338063bc7154b6573d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/2cf9a8bd6a9c40338063bc7154b6573d 2023-04-09 15:55:27,890 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023040964bf1d5ec45f4a61a9fd2067ea9a128c_del 2023-04-09 15:55:27,891 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023040964bf1d5ec45f4a61a9fd2067ea9a128c_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023040964bf1d5ec45f4a61a9fd2067ea9a128c_del 2023-04-09 15:55:28,708 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d0dd9b757094e41962b312390edd072 2023-04-09 15:55:28,709 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/.tmp/family2/5d0dd9b757094e41962b312390edd072 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/5d0dd9b757094e41962b312390edd072 2023-04-09 15:55:28,713 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d0dd9b757094e41962b312390edd072 2023-04-09 15:55:28,714 INFO [Listener at localhost/39283] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ffe3cc2905f4a676202562918179e075/family2 of ffe3cc2905f4a676202562918179e075 into 5d0dd9b757094e41962b312390edd072(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-09 15:55:28,714 DEBUG [Listener at localhost/39283] regionserver.HRegion(2289): Compaction status journal for ffe3cc2905f4a676202562918179e075: 2023-04-09 15:55:28,718 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:28,721 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:28,724 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:28,725 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:28,730 INFO [Listener at localhost/39283] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-04-09 15:55:28,764 INFO [Listener at localhost/39283] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-04-09 15:55:28,768 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230409388f43a897474795866c73f29790a9e4_del 2023-04-09 15:55:28,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/86b199a5f9c74a5c9881237d8e3b3239, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/79ae9f132fe142c49d49d7af35dc6034, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/721ccd40e70c456ca686cc3d6956577a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/ac406917fed44d81aa92bdcdb30a1cbe, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/538a1b99264b42f48490f0eaa46fe201] to archive 2023-04-09 15:55:28,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:28,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/86b199a5f9c74a5c9881237d8e3b3239 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/86b199a5f9c74a5c9881237d8e3b3239 2023-04-09 15:55:28,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/79ae9f132fe142c49d49d7af35dc6034 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/79ae9f132fe142c49d49d7af35dc6034 2023-04-09 15:55:28,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/721ccd40e70c456ca686cc3d6956577a to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/721ccd40e70c456ca686cc3d6956577a 2023-04-09 15:55:28,777 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230409bd1f36ada9ce4f8cb18c2ab7d301b736_del 2023-04-09 15:55:28,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/ac406917fed44d81aa92bdcdb30a1cbe to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/ac406917fed44d81aa92bdcdb30a1cbe 2023-04-09 15:55:28,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/538a1b99264b42f48490f0eaa46fe201 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family2/538a1b99264b42f48490f0eaa46fe201 2023-04-09 15:55:28,781 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230409932a5986c6b548e8b492ab8837e71f19_del 2023-04-09 15:55:28,782 INFO [Listener at localhost/39283] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-04-09 15:55:28,782 DEBUG [Listener at localhost/39283] zookeeper.ReadOnlyZKClient(139): Connect 0x7650a122 to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:55:28,806 DEBUG [Listener at localhost/39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f41f15c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:55:28,810 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230409 for table='ns:testMinorCompaction' and column='family1' 2023-04-09 15:55:28,810 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230409 for table='ns:testMinorCompaction' and column='family1' 2023-04-09 15:55:28,810 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230409 for table='ns:testMinorCompaction' and column='family1' 2023-04-09 15:55:28,902 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230409fe846245f2cd46e0804e3e669fdfac16 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230409fe846245f2cd46e0804e3e669fdfac16 2023-04-09 15:55:28,902 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230409 table='ns:testMinorCompaction' column='family1' 2023-04-09 15:55:28,921 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:55:28,924 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33038, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:55:28,939 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-09 15:55:28,947 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-09 15:55:28,968 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230409/family1/0ca3ab68af004303ac891790f6fb0f78 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-04-09 15:55:28,969 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230409/family1/0ca3ab68af004303ac891790f6fb0f78}] 2023-04-09 15:55:28,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230409/family1/0ca3ab68af004303ac891790f6fb0f78 for inclusion in ffe3cc2905f4a676202562918179e075/family1 2023-04-09 15:55:28,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-04-09 15:55:28,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(777): Region bounds: first=1 last=2 2023-04-09 15:55:28,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for ffe3cc2905f4a676202562918179e075: 2023-04-09 15:55:28,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230409/family1/0ca3ab68af004303ac891790f6fb0f78 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__ns_testMinorCompaction__j632vkcs6g2e0p5lp5r4elucu9dknsou5vqgb53bkte0v2heo44n87s7pt1ssutg/family1/0ca3ab68af004303ac891790f6fb0f78 2023-04-09 15:55:28,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__ns_testMinorCompaction__j632vkcs6g2e0p5lp5r4elucu9dknsou5vqgb53bkte0v2heo44n87s7pt1ssutg/family1/0ca3ab68af004303ac891790f6fb0f78 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/1d48145226674feb8597d953ebe3da55_SeqId_28_ 2023-04-09 15:55:28,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__ns_testMinorCompaction__j632vkcs6g2e0p5lp5r4elucu9dknsou5vqgb53bkte0v2heo44n87s7pt1ssutg/family1/0ca3ab68af004303ac891790f6fb0f78 into ffe3cc2905f4a676202562918179e075/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/1d48145226674feb8597d953ebe3da55_SeqId_28_ - updating store file list. 2023-04-09 15:55:28,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/1d48145226674feb8597d953ebe3da55_SeqId_28_ into ffe3cc2905f4a676202562918179e075/family1 2023-04-09 15:55:28,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__ns_testMinorCompaction__j632vkcs6g2e0p5lp5r4elucu9dknsou5vqgb53bkte0v2heo44n87s7pt1ssutg/family1/0ca3ab68af004303ac891790f6fb0f78 into ffe3cc2905f4a676202562918179e075/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/family1/1d48145226674feb8597d953ebe3da55_SeqId_28_) 2023-04-09 15:55:28,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__ns_testMinorCompaction__j632vkcs6g2e0p5lp5r4elucu9dknsou5vqgb53bkte0v2heo44n87s7pt1ssutg/family1/0ca3ab68af004303ac891790f6fb0f78 2023-04-09 15:55:28,997 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230409 table='ns:testMinorCompaction' column='family1' 2023-04-09 15:55:28,998 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:29,001 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202304099c1343ca323346cc9f63b49918d686b8 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202304099c1343ca323346cc9f63b49918d686b8 2023-04-09 15:55:29,001 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-04-09 15:55:29,001 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230409' 2023-04-09 15:55:29,001 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230409 for table='ns:testMinorCompaction' and column='family1' 2023-04-09 15:55:29,310 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409cc382e4fd4e4409e9d357fdb3ee3a884 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230409cc382e4fd4e4409e9d357fdb3ee3a884 2023-04-09 15:55:29,312 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230409 table='ns:testMinorCompaction' column='family1' 2023-04-09 15:55:29,341 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230409/family1/7b6102338a094cb6a55eb33f2090ef24 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-04-09 15:55:29,341 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230409/family1/7b6102338a094cb6a55eb33f2090ef24}] 2023-04-09 15:55:29,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230409/family1/7b6102338a094cb6a55eb33f2090ef24 for inclusion in e8d74bc0fb5ce674b95adc8cb94da50a/family1 2023-04-09 15:55:29,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-04-09 15:55:29,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last=1 2023-04-09 15:55:29,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for e8d74bc0fb5ce674b95adc8cb94da50a: 2023-04-09 15:55:29,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230409/family1/7b6102338a094cb6a55eb33f2090ef24 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__ns_testMinorCompaction__q13fcun4f5l74tmns5h6kpiocvnmo7rv239706rckccc0qv320h05uncov3njudb/family1/7b6102338a094cb6a55eb33f2090ef24 2023-04-09 15:55:29,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__ns_testMinorCompaction__q13fcun4f5l74tmns5h6kpiocvnmo7rv239706rckccc0qv320h05uncov3njudb/family1/7b6102338a094cb6a55eb33f2090ef24 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/845e7357d8134cc195ae6edc92dfcab0_SeqId_28_ 2023-04-09 15:55:29,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__ns_testMinorCompaction__q13fcun4f5l74tmns5h6kpiocvnmo7rv239706rckccc0qv320h05uncov3njudb/family1/7b6102338a094cb6a55eb33f2090ef24 into e8d74bc0fb5ce674b95adc8cb94da50a/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/845e7357d8134cc195ae6edc92dfcab0_SeqId_28_ - updating store file list. 2023-04-09 15:55:29,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/845e7357d8134cc195ae6edc92dfcab0_SeqId_28_ into e8d74bc0fb5ce674b95adc8cb94da50a/family1 2023-04-09 15:55:29,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__ns_testMinorCompaction__q13fcun4f5l74tmns5h6kpiocvnmo7rv239706rckccc0qv320h05uncov3njudb/family1/7b6102338a094cb6a55eb33f2090ef24 into e8d74bc0fb5ce674b95adc8cb94da50a/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/family1/845e7357d8134cc195ae6edc92dfcab0_SeqId_28_) 2023-04-09 15:55:29,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__ns_testMinorCompaction__q13fcun4f5l74tmns5h6kpiocvnmo7rv239706rckccc0qv320h05uncov3njudb/family1/7b6102338a094cb6a55eb33f2090ef24 2023-04-09 15:55:29,362 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230409 table='ns:testMinorCompaction' column='family1' 2023-04-09 15:55:29,362 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:29,364 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023040956d15593964e4751ba6bce48cf6483c8 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023040956d15593964e4751ba6bce48cf6483c8 2023-04-09 15:55:29,365 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-04-09 15:55:29,365 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230409' 2023-04-09 15:55:29,366 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230409 for table='ns:testMinorCompaction' and column='family1' 2023-04-09 15:55:29,712 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409586dcb543f7846df8ead4a148d9b105b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230409586dcb543f7846df8ead4a148d9b105b 2023-04-09 15:55:29,713 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230409 table='ns:testMinorCompaction' column='family1' 2023-04-09 15:55:29,745 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230409/family1/faf2a0b3d288486b8aae42e086b0becd first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-04-09 15:55:29,749 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230409/family1/faf2a0b3d288486b8aae42e086b0becd}] 2023-04-09 15:55:29,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230409/family1/faf2a0b3d288486b8aae42e086b0becd for inclusion in ff29b220fa2e52fe8f06bb62f0a0c261/family1 2023-04-09 15:55:29,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-04-09 15:55:29,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(777): Region bounds: first=2 last= 2023-04-09 15:55:29,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for ff29b220fa2e52fe8f06bb62f0a0c261: 2023-04-09 15:55:29,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230409/family1/faf2a0b3d288486b8aae42e086b0becd to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__ns_testMinorCompaction__f218klf59cf0t127hufvk69llo5l1ohfrsh2uhdrut1s24s75m6f6s4t2oicjn5d/family1/faf2a0b3d288486b8aae42e086b0becd 2023-04-09 15:55:29,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__ns_testMinorCompaction__f218klf59cf0t127hufvk69llo5l1ohfrsh2uhdrut1s24s75m6f6s4t2oicjn5d/family1/faf2a0b3d288486b8aae42e086b0becd as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/b5386042d6bd46b6987efa0a3f905926_SeqId_28_ 2023-04-09 15:55:29,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__ns_testMinorCompaction__f218klf59cf0t127hufvk69llo5l1ohfrsh2uhdrut1s24s75m6f6s4t2oicjn5d/family1/faf2a0b3d288486b8aae42e086b0becd into ff29b220fa2e52fe8f06bb62f0a0c261/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/b5386042d6bd46b6987efa0a3f905926_SeqId_28_ - updating store file list. 2023-04-09 15:55:29,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/b5386042d6bd46b6987efa0a3f905926_SeqId_28_ into ff29b220fa2e52fe8f06bb62f0a0c261/family1 2023-04-09 15:55:29,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__ns_testMinorCompaction__f218klf59cf0t127hufvk69llo5l1ohfrsh2uhdrut1s24s75m6f6s4t2oicjn5d/family1/faf2a0b3d288486b8aae42e086b0becd into ff29b220fa2e52fe8f06bb62f0a0c261/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/family1/b5386042d6bd46b6987efa0a3f905926_SeqId_28_) 2023-04-09 15:55:29,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__ns_testMinorCompaction__f218klf59cf0t127hufvk69llo5l1ohfrsh2uhdrut1s24s75m6f6s4t2oicjn5d/family1/faf2a0b3d288486b8aae42e086b0becd 2023-04-09 15:55:29,760 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230409 table='ns:testMinorCompaction' column='family1' 2023-04-09 15:55:29,761 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:29,762 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202304095a69e1260572458d9dbb15e1b86584bd to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202304095a69e1260572458d9dbb15e1b86584bd 2023-04-09 15:55:29,762 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-04-09 15:55:29,762 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230409' 2023-04-09 15:55:29,762 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230409 for table='ns:testMinorCompaction' and column='family1' 2023-04-09 15:55:29,762 INFO [Listener at localhost/39283] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-04-09 15:55:29,765 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:29,767 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:29,769 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:29,770 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:29,786 INFO [Listener at localhost/39283] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=251 (was 285), OpenFileDescriptor=637 (was 757), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=384 (was 384), ProcessCount=169 (was 169), AvailableMemoryMB=1433 (was 1441) 2023-04-09 15:55:29,799 INFO [Listener at localhost/39283] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=251, OpenFileDescriptor=637, MaxFileDescriptor=60000, SystemLoadAverage=384, ProcessCount=169, AvailableMemoryMB=1433 2023-04-09 15:55:29,801 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-04-09 15:55:29,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:29,802 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-04-09 15:55:29,803 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-04-09 15:55:29,803 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-09 15:55:29,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-04-09 15:55:29,804 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6 2023-04-09 15:55:29,805 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6 empty. 2023-04-09 15:55:29,805 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6 2023-04-09 15:55:29,805 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-04-09 15:55:29,811 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-04-09 15:55:29,813 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 38da5d3a3cb865aa14dc3d24abb615b6, NAME => 'testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:55:29,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-04-09 15:55:30,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-04-09 15:55:30,218 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:55:30,218 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 38da5d3a3cb865aa14dc3d24abb615b6, disabling compactions & flushes 2023-04-09 15:55:30,218 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:30,218 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:30,218 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. after waiting 0 ms 2023-04-09 15:55:30,218 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:30,218 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:30,218 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 38da5d3a3cb865aa14dc3d24abb615b6: 2023-04-09 15:55:30,221 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-04-09 15:55:30,221 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1681055730221"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055730221"}]},"ts":"1681055730221"} 2023-04-09 15:55:30,224 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-04-09 15:55:30,225 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-09 15:55:30,225 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055730225"}]},"ts":"1681055730225"} 2023-04-09 15:55:30,226 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-04-09 15:55:30,230 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=38da5d3a3cb865aa14dc3d24abb615b6, ASSIGN}] 2023-04-09 15:55:30,231 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=38da5d3a3cb865aa14dc3d24abb615b6, ASSIGN 2023-04-09 15:55:30,233 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=38da5d3a3cb865aa14dc3d24abb615b6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:55:30,384 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=38da5d3a3cb865aa14dc3d24abb615b6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:30,385 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1681055730384"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055730384"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055730384"}]},"ts":"1681055730384"} 2023-04-09 15:55:30,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 38da5d3a3cb865aa14dc3d24abb615b6, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:55:30,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-04-09 15:55:30,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:30,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 38da5d3a3cb865aa14dc3d24abb615b6, NAME => 'testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6.', STARTKEY => '', ENDKEY => ''} 2023-04-09 15:55:30,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 38da5d3a3cb865aa14dc3d24abb615b6 2023-04-09 15:55:30,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:55:30,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 38da5d3a3cb865aa14dc3d24abb615b6 2023-04-09 15:55:30,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 38da5d3a3cb865aa14dc3d24abb615b6 2023-04-09 15:55:30,542 INFO [StoreOpener-38da5d3a3cb865aa14dc3d24abb615b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 38da5d3a3cb865aa14dc3d24abb615b6 2023-04-09 15:55:30,543 DEBUG [StoreOpener-38da5d3a3cb865aa14dc3d24abb615b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1 2023-04-09 15:55:30,544 DEBUG [StoreOpener-38da5d3a3cb865aa14dc3d24abb615b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1 2023-04-09 15:55:30,544 INFO [StoreOpener-38da5d3a3cb865aa14dc3d24abb615b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38da5d3a3cb865aa14dc3d24abb615b6 columnFamilyName family1 2023-04-09 15:55:30,545 INFO [StoreOpener-38da5d3a3cb865aa14dc3d24abb615b6-1] regionserver.HStore(310): Store=38da5d3a3cb865aa14dc3d24abb615b6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:30,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6 2023-04-09 15:55:30,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6 2023-04-09 15:55:30,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 38da5d3a3cb865aa14dc3d24abb615b6 2023-04-09 15:55:30,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:55:30,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 38da5d3a3cb865aa14dc3d24abb615b6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61186713, jitterRate=-0.08824692666530609}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-04-09 15:55:30,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 38da5d3a3cb865aa14dc3d24abb615b6: 2023-04-09 15:55:30,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6., pid=114, masterSystemTime=1681055730538 2023-04-09 15:55:30,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:30,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:30,553 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=38da5d3a3cb865aa14dc3d24abb615b6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:30,554 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1681055730553"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055730553"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055730553"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055730553"}]},"ts":"1681055730553"} 2023-04-09 15:55:30,556 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-04-09 15:55:30,557 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 38da5d3a3cb865aa14dc3d24abb615b6, server=jenkins-hbase4.apache.org,44869,1681055618167 in 169 msec 2023-04-09 15:55:30,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-04-09 15:55:30,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=38da5d3a3cb865aa14dc3d24abb615b6, ASSIGN in 327 msec 2023-04-09 15:55:30,559 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-09 15:55:30,559 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055730559"}]},"ts":"1681055730559"} 2023-04-09 15:55:30,560 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-04-09 15:55:30,563 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-04-09 15:55:30,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 763 msec 2023-04-09 15:55:30,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-04-09 15:55:30,907 INFO [Listener at localhost/39283] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-04-09 15:55:30,934 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:30,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:30,946 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:30,946 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:30,946 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:55:30,946 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:55:30,947 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:30,947 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:30,950 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:30,950 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:30,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:30,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:30,950 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:30,950 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:30,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:30,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:30,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:30,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:30,951 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:30,951 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:30,951 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:55:30,951 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:30,951 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:55:30,954 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:55:30,954 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:30,954 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:30,954 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. started... 2023-04-09 15:55:30,955 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38da5d3a3cb865aa14dc3d24abb615b6 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-04-09 15:55:30,994 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113077722ab8f87c4204ab5c8442722bc728 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113077722ab8f87c4204ab5c8442722bc728 2023-04-09 15:55:31,397 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/3b91997eefb14377969fc37f34bfa5b2 2023-04-09 15:55:31,402 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/3b91997eefb14377969fc37f34bfa5b2 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/3b91997eefb14377969fc37f34bfa5b2 2023-04-09 15:55:31,407 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/3b91997eefb14377969fc37f34bfa5b2, entries=1000, sequenceid=5, filesize=166.0 K 2023-04-09 15:55:31,408 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 38da5d3a3cb865aa14dc3d24abb615b6 in 453ms, sequenceid=5, compaction requested=false 2023-04-09 15:55:31,408 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:31,409 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38da5d3a3cb865aa14dc3d24abb615b6: 2023-04-09 15:55:31,409 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:31,409 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:55:31,409 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:55:31,409 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:31,409 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:55:31,409 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:55:31,411 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:31,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:31,411 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:31,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:31,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:31,412 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,412 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:31,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:31,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:31,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:31,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:55:31,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25081595[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:31,413 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:55:31,413 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,414 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,414 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:55:31,415 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:55:31,415 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:31,415 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:31,415 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:31,416 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:31,416 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:55:31,416 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:31,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:31,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:31,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:31,416 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:55:31,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:31,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:31,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:31,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:31,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:31,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:31,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:55:31,419 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:55:31,419 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:31,419 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:31,419 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,419 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:31,422 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,422 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:31,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,422 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:31,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:31,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:31,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:31,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:31,423 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:31,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:31,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:31,424 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:31,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:31,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,428 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:31,428 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:31,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:31,428 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:31,428 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:31,428 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:31,428 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,428 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,428 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:31,428 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,428 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,428 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:31,428 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:31,429 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:31,428 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:31,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:31,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:31,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:31,432 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-09 15:55:31,529 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:31,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:31,534 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:31,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:55:31,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,537 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:31,537 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:31,537 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:55:31,537 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:55:31,539 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,539 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,540 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:31,541 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:31,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:31,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,543 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:31,544 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:31,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,544 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,545 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-04-09 15:55:31,545 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:31,545 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:55:31,545 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:31,545 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:55:31,545 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:55:31,545 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:31,545 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:31,545 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. started... 2023-04-09 15:55:31,545 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38da5d3a3cb865aa14dc3d24abb615b6 1/1 column families, dataSize=74 B heapSize=408 B 2023-04-09 15:55:31,966 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d3aa59cefc134d8f9eb4b028ff00aedc to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128d3aa59cefc134d8f9eb4b028ff00aedc 2023-04-09 15:55:32,001 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/586e880ec0194a3d958a4dcc35ef1ba1 2023-04-09 15:55:32,005 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/586e880ec0194a3d958a4dcc35ef1ba1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/586e880ec0194a3d958a4dcc35ef1ba1 2023-04-09 15:55:32,009 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/586e880ec0194a3d958a4dcc35ef1ba1, entries=1, sequenceid=9, filesize=5.0 K 2023-04-09 15:55:32,010 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 38da5d3a3cb865aa14dc3d24abb615b6 in 465ms, sequenceid=9, compaction requested=false 2023-04-09 15:55:32,010 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38da5d3a3cb865aa14dc3d24abb615b6: 2023-04-09 15:55:32,010 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:32,010 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:55:32,010 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:55:32,010 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,010 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:55:32,010 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:55:32,013 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,013 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:32,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:32,013 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,014 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:32,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:32,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:32,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:32,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:55:32,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fb9db80[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:32,015 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:55:32,015 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,017 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,017 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:55:32,017 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:55:32,017 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:32,018 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,018 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:32,019 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:55:32,019 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:32,019 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,019 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:55:32,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:32,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:32,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:32,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:32,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:32,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:32,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:55:32,023 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:55:32,023 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:32,023 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:32,023 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,023 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:32,024 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:32,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:32,025 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,025 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:32,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:32,025 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:32,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:32,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:32,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,026 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:32,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,028 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:32,028 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,028 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:32,029 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:32,029 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,029 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:32,029 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,029 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,029 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,029 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,029 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:32,029 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:32,029 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:32,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-09 15:55:32,029 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:32,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:32,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:32,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:32,129 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:32,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:32,134 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:32,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:55:32,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,135 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:32,135 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:32,135 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:55:32,135 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:55:32,136 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,136 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,141 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:32,141 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:32,141 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,141 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,142 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,142 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-04-09 15:55:32,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,142 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:55:32,143 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:32,143 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:55:32,143 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:55:32,143 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:32,143 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:32,143 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. started... 2023-04-09 15:55:32,143 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38da5d3a3cb865aa14dc3d24abb615b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:55:32,558 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ea651854a90a4535ac13f4ffb4396f39 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201ea651854a90a4535ac13f4ffb4396f39 2023-04-09 15:55:32,964 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/e6aa6a32ba984beeb59d320af7084e01 2023-04-09 15:55:32,968 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/e6aa6a32ba984beeb59d320af7084e01 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/e6aa6a32ba984beeb59d320af7084e01 2023-04-09 15:55:32,972 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/e6aa6a32ba984beeb59d320af7084e01, entries=1, sequenceid=13, filesize=4.9 K 2023-04-09 15:55:32,972 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38da5d3a3cb865aa14dc3d24abb615b6 in 829ms, sequenceid=13, compaction requested=true 2023-04-09 15:55:32,973 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38da5d3a3cb865aa14dc3d24abb615b6: 2023-04-09 15:55:32,973 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:32,973 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:55:32,973 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:55:32,973 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,973 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:55:32,973 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:55:32,975 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,975 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:32,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:32,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:32,975 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,976 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:32,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:55:32,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e0a44b[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:32,977 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:55:32,977 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,978 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,978 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:55:32,978 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:55:32,978 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:32,978 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,978 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:32,979 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,980 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:55:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:32,980 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:32,980 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:55:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:32,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:32,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:55:32,982 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:55:32,982 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:32,982 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:32,982 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,982 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:32,985 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:32,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:32,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:32,985 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:32,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,986 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:32,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,988 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,989 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,989 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,989 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:32,989 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,989 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,989 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:32,989 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-09 15:55:32,989 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,989 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:32,989 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:32,989 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:32,989 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:32,989 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,989 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:32,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:32,989 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:32,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-09 15:55:32,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:32,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:32,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:32,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:33,089 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:33,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:33,094 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:33,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:55:33,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,096 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:33,096 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:33,096 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:55:33,096 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:55:33,097 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,097 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,098 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:33,098 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:33,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:33,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:33,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,101 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:33,101 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:33,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:33,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,108 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,109 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-04-09 15:55:33,109 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,109 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:55:33,109 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:33,109 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:55:33,117 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:55:33,117 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:33,117 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:33,117 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. started... 2023-04-09 15:55:33,117 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38da5d3a3cb865aa14dc3d24abb615b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:55:33,544 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512050b0d3d03534a476f9e8efb5c3da35e66 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512050b0d3d03534a476f9e8efb5c3da35e66 2023-04-09 15:55:33,955 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/dfb61016b332483b862f7f3ab23f827a 2023-04-09 15:55:33,959 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/dfb61016b332483b862f7f3ab23f827a as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/dfb61016b332483b862f7f3ab23f827a 2023-04-09 15:55:33,962 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/dfb61016b332483b862f7f3ab23f827a, entries=1, sequenceid=17, filesize=4.9 K 2023-04-09 15:55:33,963 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38da5d3a3cb865aa14dc3d24abb615b6 in 846ms, sequenceid=17, compaction requested=true 2023-04-09 15:55:33,963 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38da5d3a3cb865aa14dc3d24abb615b6: 2023-04-09 15:55:33,963 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:33,963 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:55:33,963 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:55:33,963 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:33,963 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:55:33,963 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:55:33,965 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,965 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:33,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:33,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:33,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:33,965 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,965 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:33,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:33,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:33,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:33,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:33,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:55:33,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fc5f85a[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:33,966 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:55:33,966 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,968 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,969 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:55:33,969 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:55:33,969 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:33,969 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:33,969 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:33,970 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:55:33,970 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:33,970 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:33,970 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:55:33,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:33,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:33,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:33,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:33,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:33,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:33,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:33,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:33,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:33,972 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:55:33,972 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:55:33,972 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:33,972 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:33,972 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,973 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:33,974 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,974 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,974 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:33,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:33,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:33,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:33,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:33,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:33,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,975 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:33,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,976 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:33,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:33,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,978 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:33,978 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:33,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:33,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:33,978 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:33,978 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:33,979 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:33,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:33,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:33,979 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:33,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-09 15:55:33,979 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:33,980 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:33,980 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,980 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,980 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:33,980 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,980 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:33,980 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,079 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:34,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:34,084 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:34,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:55:34,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,086 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:34,086 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:34,086 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:55:34,086 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:55:34,087 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,087 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,089 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:34,089 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:34,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:34,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:34,089 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:34,089 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:34,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:34,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,090 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,090 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-04-09 15:55:34,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,090 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:55:34,091 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:34,091 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:55:34,096 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:55:34,096 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:34,096 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:34,096 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. started... 2023-04-09 15:55:34,096 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38da5d3a3cb865aa14dc3d24abb615b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:55:34,515 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285262500da4c747e08f90f1584bc65d54 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512285262500da4c747e08f90f1584bc65d54 2023-04-09 15:55:34,533 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-09 15:55:34,533 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7650a122 to 127.0.0.1:64813 2023-04-09 15:55:34,533 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:55:34,533 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-09 15:55:34,533 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x567a176b to 127.0.0.1:64813 2023-04-09 15:55:34,533 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:55:34,934 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/4142fde4a86445419894f5c302785d6d 2023-04-09 15:55:34,938 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/4142fde4a86445419894f5c302785d6d as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/4142fde4a86445419894f5c302785d6d 2023-04-09 15:55:34,942 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/4142fde4a86445419894f5c302785d6d, entries=1, sequenceid=21, filesize=4.9 K 2023-04-09 15:55:34,943 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38da5d3a3cb865aa14dc3d24abb615b6 in 847ms, sequenceid=21, compaction requested=true 2023-04-09 15:55:34,943 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38da5d3a3cb865aa14dc3d24abb615b6: 2023-04-09 15:55:34,943 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:34,943 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:55:34,943 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:55:34,943 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:34,943 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:55:34,943 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:55:34,945 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:34,945 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,945 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,945 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:34,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:34,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:34,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:34,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:34,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:34,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:34,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:34,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:55:34,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e977c5c[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:34,948 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:55:34,948 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,950 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,950 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:55:34,950 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:55:34,950 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:34,951 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:34,951 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:34,952 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:55:34,952 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:34,952 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:34,952 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:55:34,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:34,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:34,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:34,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:34,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:34,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:34,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:34,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:34,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:34,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:55:34,954 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:55:34,954 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:34,954 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:34,954 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,954 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:34,956 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,956 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:34,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:34,956 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:34,957 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:34,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:34,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:34,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:34,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:34,958 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:34,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:34,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:34,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:34,963 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:34,963 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:34,963 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:34,963 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:34,963 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:34,963 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:34,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-09 15:55:34,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:34,963 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:34,963 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,963 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:34,963 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,963 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:34,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:34,964 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:34,963 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:34,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:34,964 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,064 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:35,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:35,068 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:35,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:55:35,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,070 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:35,070 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:35,070 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:55:35,070 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:55:35,071 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,071 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,072 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,072 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:35,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:35,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:35,072 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,072 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:35,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:35,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,073 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,073 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-04-09 15:55:35,073 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,073 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:55:35,074 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:35,074 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:55:35,074 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:55:35,074 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:35,074 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:35,074 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. started... 2023-04-09 15:55:35,074 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38da5d3a3cb865aa14dc3d24abb615b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:55:35,088 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312214c206a17c4feba37d2ca5bedccbe4 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512312214c206a17c4feba37d2ca5bedccbe4 2023-04-09 15:55:35,093 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/01155ca7ca4f432d8eea0d6b3c76bd3d 2023-04-09 15:55:35,097 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/01155ca7ca4f432d8eea0d6b3c76bd3d as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/01155ca7ca4f432d8eea0d6b3c76bd3d 2023-04-09 15:55:35,100 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/01155ca7ca4f432d8eea0d6b3c76bd3d, entries=1, sequenceid=25, filesize=4.9 K 2023-04-09 15:55:35,101 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38da5d3a3cb865aa14dc3d24abb615b6 in 27ms, sequenceid=25, compaction requested=true 2023-04-09 15:55:35,101 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38da5d3a3cb865aa14dc3d24abb615b6: 2023-04-09 15:55:35,101 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:35,101 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:55:35,101 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:55:35,101 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,101 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:55:35,101 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:55:35,103 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,103 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:35,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:35,104 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,104 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:35,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:35,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:35,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:35,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:55:35,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ee052fc[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:35,105 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:55:35,105 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,106 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,106 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:55:35,106 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:55:35,106 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,107 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:35,106 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:35,108 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,108 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:55:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:35,108 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:35,108 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:55:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:35,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:35,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:35,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:35,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:55:35,111 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:55:35,111 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:35,111 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:35,111 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,111 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:35,113 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,113 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:35,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:35,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:35,113 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,114 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:35,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:35,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:35,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,115 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:35,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:35,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,118 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:35,118 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:35,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:35,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:35,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:35,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:35,119 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,119 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,119 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,119 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:35,119 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,119 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,119 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,119 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,119 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:35,120 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:35,120 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-09 15:55:35,120 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:35,120 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:35,220 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:35,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:35,225 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:35,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:55:35,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,227 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:35,227 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:35,227 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:55:35,227 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:55:35,227 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,227 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,229 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:35,229 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:35,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:35,229 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,229 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:35,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:35,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,230 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,230 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-04-09 15:55:35,230 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,230 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:55:35,230 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:35,230 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:55:35,230 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:55:35,230 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:35,230 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:35,231 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. started... 2023-04-09 15:55:35,231 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38da5d3a3cb865aa14dc3d24abb615b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:55:35,246 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101aef98c318efb4a2585b33c666e9f43ec to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101aef98c318efb4a2585b33c666e9f43ec 2023-04-09 15:55:35,251 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/d4fe9d97b6d6453aa2bd4a54a09a4bd8 2023-04-09 15:55:35,254 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/d4fe9d97b6d6453aa2bd4a54a09a4bd8 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/d4fe9d97b6d6453aa2bd4a54a09a4bd8 2023-04-09 15:55:35,257 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/d4fe9d97b6d6453aa2bd4a54a09a4bd8, entries=1, sequenceid=29, filesize=4.9 K 2023-04-09 15:55:35,258 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38da5d3a3cb865aa14dc3d24abb615b6 in 27ms, sequenceid=29, compaction requested=true 2023-04-09 15:55:35,258 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38da5d3a3cb865aa14dc3d24abb615b6: 2023-04-09 15:55:35,258 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:35,258 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:55:35,258 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:55:35,258 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,258 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:55:35,258 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:55:35,260 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,260 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:35,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:35,260 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,260 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:35,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:35,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:35,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:35,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:55:35,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63ad3710[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:35,261 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:55:35,261 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,262 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,262 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:55:35,263 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:55:35,263 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:35,263 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,263 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:35,264 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,264 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:55:35,265 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:35,265 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:55:35,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:35,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:35,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:35,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:35,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:55:35,267 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:55:35,267 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:35,267 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:35,267 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,267 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:35,268 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,268 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:35,268 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:35,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:35,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,269 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:35,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:35,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:35,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,270 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,272 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:35,272 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:35,272 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:35,273 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:35,272 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:35,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:35,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:35,272 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:35,272 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,273 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,273 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:35,273 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,273 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,273 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,273 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:35,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:35,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:35,273 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-09 15:55:35,373 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:35,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:35,378 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:35,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:55:35,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,379 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:35,380 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:35,380 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:55:35,380 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:55:35,380 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,380 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,381 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:35,381 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:35,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:35,382 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,382 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:35,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:35,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,383 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,383 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-04-09 15:55:35,383 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,383 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:55:35,383 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:35,383 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:55:35,383 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:55:35,383 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:35,383 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:35,383 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. started... 2023-04-09 15:55:35,384 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38da5d3a3cb865aa14dc3d24abb615b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:55:35,397 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036b3d2f05373e4729b727456ccdabeb87 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601036b3d2f05373e4729b727456ccdabeb87 2023-04-09 15:55:35,802 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/80a1b0f7b53f45ae86779f10c9d48ba6 2023-04-09 15:55:35,807 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/80a1b0f7b53f45ae86779f10c9d48ba6 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/80a1b0f7b53f45ae86779f10c9d48ba6 2023-04-09 15:55:35,811 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/80a1b0f7b53f45ae86779f10c9d48ba6, entries=1, sequenceid=33, filesize=4.9 K 2023-04-09 15:55:35,812 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38da5d3a3cb865aa14dc3d24abb615b6 in 428ms, sequenceid=33, compaction requested=true 2023-04-09 15:55:35,813 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38da5d3a3cb865aa14dc3d24abb615b6: 2023-04-09 15:55:35,813 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:35,813 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:55:35,813 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:55:35,813 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,813 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:55:35,813 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:55:35,815 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,815 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:35,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:35,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:35,816 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,816 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:35,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:35,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:35,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:55:35,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a682caf[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:35,817 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:55:35,817 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,819 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,819 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:55:35,819 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:55:35,819 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:35,819 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,819 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:35,821 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,821 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:55:35,821 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:35,821 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:55:35,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:35,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:35,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:35,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:35,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:55:35,825 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:55:35,825 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:35,825 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:35,825 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,825 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:35,830 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,830 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,830 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:35,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:35,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:35,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:35,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:35,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:35,831 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:35,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,833 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:35,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,835 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,835 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,835 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,835 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-09 15:55:35,836 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:35,836 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:35,836 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:35,836 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:35,836 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:35,835 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,836 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,836 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:35,836 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:35,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:35,836 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:35,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:35,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:35,936 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:35,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:35,942 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:35,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:55:35,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,952 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:35,952 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:35,952 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:55:35,952 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:55:35,953 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,953 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,955 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:35,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:35,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:35,955 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,956 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:35,956 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:35,956 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,957 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,960 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-04-09 15:55:35,960 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:35,960 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:55:35,960 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:35,960 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:55:35,964 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:55:35,964 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:35,964 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:35,964 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. started... 2023-04-09 15:55:35,964 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38da5d3a3cb865aa14dc3d24abb615b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:55:35,987 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907da60200a67cd4d82a6aa7d0978a419c9 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907da60200a67cd4d82a6aa7d0978a419c9 2023-04-09 15:55:35,998 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/513afddd325843f4aab8be41f09a6708 2023-04-09 15:55:36,008 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/513afddd325843f4aab8be41f09a6708 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/513afddd325843f4aab8be41f09a6708 2023-04-09 15:55:36,014 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/513afddd325843f4aab8be41f09a6708, entries=1, sequenceid=37, filesize=4.9 K 2023-04-09 15:55:36,015 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38da5d3a3cb865aa14dc3d24abb615b6 in 51ms, sequenceid=37, compaction requested=true 2023-04-09 15:55:36,015 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38da5d3a3cb865aa14dc3d24abb615b6: 2023-04-09 15:55:36,015 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:36,015 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:55:36,015 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:55:36,015 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,015 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:55:36,015 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:55:36,017 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:36,017 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:36,017 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,017 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:36,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:36,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:36,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:36,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:55:36,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fa8c822[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:36,019 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:55:36,019 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,021 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,021 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:55:36,021 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:55:36,022 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:36,023 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,023 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:55:36,023 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:36,023 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:55:36,023 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:55:36,023 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:36,023 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:55:36,023 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:36,023 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:36,024 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,024 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:36,026 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,027 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,027 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:36,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:36,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:36,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:36,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:36,027 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:36,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:36,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,030 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:36,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,032 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,032 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:36,032 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:36,032 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:36,032 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:36,032 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:36,032 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:36,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-04-09 15:55:36,032 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,032 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:36,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:36,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:36,033 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,033 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,033 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,033 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:36,033 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:36,105 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-09 15:55:36,133 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:36,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:36,138 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:36,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-04-09 15:55:36,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,140 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:36,140 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:36,140 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-04-09 15:55:36,140 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-04-09 15:55:36,140 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,140 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,142 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,142 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:36,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:36,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:36,142 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,142 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:36,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:36,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,143 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,144 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-04-09 15:55:36,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,145 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-04-09 15:55:36,145 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:36,145 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-04-09 15:55:36,145 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-04-09 15:55:36,145 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:36,146 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:36,146 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. started... 2023-04-09 15:55:36,146 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 38da5d3a3cb865aa14dc3d24abb615b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-04-09 15:55:36,161 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112017b1ab7f2e36475f8c56d769db5f1244 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112017b1ab7f2e36475f8c56d769db5f1244 2023-04-09 15:55:36,169 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/ec5c262628ab45baa44755b342ef2194 2023-04-09 15:55:36,173 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/ec5c262628ab45baa44755b342ef2194 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/ec5c262628ab45baa44755b342ef2194 2023-04-09 15:55:36,177 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/ec5c262628ab45baa44755b342ef2194, entries=1, sequenceid=41, filesize=4.9 K 2023-04-09 15:55:36,178 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38da5d3a3cb865aa14dc3d24abb615b6 in 32ms, sequenceid=41, compaction requested=true 2023-04-09 15:55:36,178 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 38da5d3a3cb865aa14dc3d24abb615b6: 2023-04-09 15:55:36,178 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:36,178 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-04-09 15:55:36,178 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-04-09 15:55:36,178 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,178 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-04-09 15:55:36,178 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-04-09 15:55:36,180 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,180 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:36,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:36,181 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,181 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:36,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:36,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:36,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:36,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-04-09 15:55:36,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23a31699[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:36,182 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-04-09 15:55:36,182 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,184 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,184 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-04-09 15:55:36,184 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-04-09 15:55:36,184 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:36,184 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,184 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:36,187 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,187 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-04-09 15:55:36,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:36,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:36,187 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:36,187 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-04-09 15:55:36,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:36,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:36,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:36,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:36,191 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-04-09 15:55:36,191 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:36,191 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:36,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-04-09 15:55:36,191 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,191 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:36,193 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,193 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,194 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:36,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:36,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:36,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:36,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:36,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:36,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,195 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:36,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,196 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:36,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,200 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,200 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:36,200 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:36,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:36,200 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:36,200 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-04-09 15:55:36,200 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:36,200 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:36,200 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,200 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:36,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:36,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:36,200 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,200 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:36,200 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:36,200 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,200 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,300 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:36,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:36,302 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33617] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-04-09 15:55:36,304 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-04-09 15:55:36,305 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-04-09 15:55:36,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:55:36,306 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1681056336306 2023-04-09 15:55:36,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-04-09 15:55:36,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-04-09 15:55:36,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-04-09 15:55:36,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] zookeeper.ReadOnlyZKClient(139): Connect 0x4111bddc to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:55:36,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51bddc66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:55:36,316 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-04-09 15:55:36,746 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038f125b9a5fb54048864816930a916d48 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601038f125b9a5fb54048864816930a916d48 2023-04-09 15:55:36,747 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-04-09 15:55:36,760 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:55:36,763 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:55:36,768 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-09 15:55:36,770 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-09 15:55:36,780 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7043d384548b4fb0a2bece703bc1ceb4 first=Optional[r5] last=Optional[r6] 2023-04-09 15:55:36,784 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7043d384548b4fb0a2bece703bc1ceb4}] 2023-04-09 15:55:36,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7043d384548b4fb0a2bece703bc1ceb4 for inclusion in 38da5d3a3cb865aa14dc3d24abb615b6/family1 2023-04-09 15:55:36,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-04-09 15:55:36,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:55:36,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for 38da5d3a3cb865aa14dc3d24abb615b6: 2023-04-09 15:55:36,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7043d384548b4fb0a2bece703bc1ceb4 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__urtg4flr2nqnnk9i03l3b20l0p8fko9hi94ksirs1th9tcpugo0bor2eba4lqkgc/family1/7043d384548b4fb0a2bece703bc1ceb4 2023-04-09 15:55:36,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__urtg4flr2nqnnk9i03l3b20l0p8fko9hi94ksirs1th9tcpugo0bor2eba4lqkgc/family1/7043d384548b4fb0a2bece703bc1ceb4 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/6a18371b693b4fffa94781a000f7155d_SeqId_44_ 2023-04-09 15:55:36,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__urtg4flr2nqnnk9i03l3b20l0p8fko9hi94ksirs1th9tcpugo0bor2eba4lqkgc/family1/7043d384548b4fb0a2bece703bc1ceb4 into 38da5d3a3cb865aa14dc3d24abb615b6/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/6a18371b693b4fffa94781a000f7155d_SeqId_44_ - updating store file list. 2023-04-09 15:55:36,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/6a18371b693b4fffa94781a000f7155d_SeqId_44_ into 38da5d3a3cb865aa14dc3d24abb615b6/family1 2023-04-09 15:55:36,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__urtg4flr2nqnnk9i03l3b20l0p8fko9hi94ksirs1th9tcpugo0bor2eba4lqkgc/family1/7043d384548b4fb0a2bece703bc1ceb4 into 38da5d3a3cb865aa14dc3d24abb615b6/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/6a18371b693b4fffa94781a000f7155d_SeqId_44_) 2023-04-09 15:55:36,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__urtg4flr2nqnnk9i03l3b20l0p8fko9hi94ksirs1th9tcpugo0bor2eba4lqkgc/family1/7043d384548b4fb0a2bece703bc1ceb4 2023-04-09 15:55:36,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-04-09 15:55:36,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-04-09 15:55:36,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(1912): 38da5d3a3cb865aa14dc3d24abb615b6/family1 is initiating minor compaction 2023-04-09 15:55:36,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@53cefff5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:55:36,812 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 38da5d3a3cb865aa14dc3d24abb615b6/family1 in testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:36,812 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/586e880ec0194a3d958a4dcc35ef1ba1, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/e6aa6a32ba984beeb59d320af7084e01, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/dfb61016b332483b862f7f3ab23f827a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/4142fde4a86445419894f5c302785d6d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/01155ca7ca4f432d8eea0d6b3c76bd3d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/d4fe9d97b6d6453aa2bd4a54a09a4bd8, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/80a1b0f7b53f45ae86779f10c9d48ba6, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/513afddd325843f4aab8be41f09a6708, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/ec5c262628ab45baa44755b342ef2194, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/6a18371b693b4fffa94781a000f7155d_SeqId_44_] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp, totalSize=49.7 K 2023-04-09 15:55:36,812 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 586e880ec0194a3d958a4dcc35ef1ba1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-04-09 15:55:36,812 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting e6aa6a32ba984beeb59d320af7084e01, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-04-09 15:55:36,812 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting dfb61016b332483b862f7f3ab23f827a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-04-09 15:55:36,812 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 4142fde4a86445419894f5c302785d6d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-04-09 15:55:36,812 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 01155ca7ca4f432d8eea0d6b3c76bd3d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-04-09 15:55:36,812 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting d4fe9d97b6d6453aa2bd4a54a09a4bd8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-04-09 15:55:36,812 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 80a1b0f7b53f45ae86779f10c9d48ba6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-04-09 15:55:36,813 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 513afddd325843f4aab8be41f09a6708, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-04-09 15:55:36,813 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting ec5c262628ab45baa44755b342ef2194, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-04-09 15:55:36,813 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 6a18371b693b4fffa94781a000f7155d_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-04-09 15:55:36,818 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-04-09 15:55:36,819 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:36,823 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101aef98c318efb4a2585b33c666e9f43ec to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101aef98c318efb4a2585b33c666e9f43ec 2023-04-09 15:55:36,824 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601036b3d2f05373e4729b727456ccdabeb87 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601036b3d2f05373e4729b727456ccdabeb87 2023-04-09 15:55:36,825 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-04-09 15:55:36,825 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-04-09 15:55:36,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-04-09 15:55:36,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-04-09 15:55:36,884 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] throttle.PressureAwareThroughputController(145): 38da5d3a3cb865aa14dc3d24abb615b6#family1#compaction#165 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-04-09 15:55:37,308 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/eafee78c16a74d1980fe030c0c0c0a00 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/eafee78c16a74d1980fe030c0c0c0a00 2023-04-09 15:55:37,314 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231dc0d2011544641baafe1f4244479bbfa to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231dc0d2011544641baafe1f4244479bbfa 2023-04-09 15:55:37,315 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-04-09 15:55:37,318 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 38da5d3a3cb865aa14dc3d24abb615b6/family1 of 38da5d3a3cb865aa14dc3d24abb615b6 into eafee78c16a74d1980fe030c0c0c0a00(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:55:37,318 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 38da5d3a3cb865aa14dc3d24abb615b6: 2023-04-09 15:55:37,318 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1681055736812; duration=0sec 2023-04-09 15:55:37,318 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:55:37,348 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/fccf5d8debd04944aecb67dbdc898286 first=Optional[r1] last=Optional[r4] 2023-04-09 15:55:37,349 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/fccf5d8debd04944aecb67dbdc898286}] 2023-04-09 15:55:37,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/fccf5d8debd04944aecb67dbdc898286 for inclusion in 38da5d3a3cb865aa14dc3d24abb615b6/family1 2023-04-09 15:55:37,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-04-09 15:55:37,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:55:37,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for 38da5d3a3cb865aa14dc3d24abb615b6: 2023-04-09 15:55:37,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/fccf5d8debd04944aecb67dbdc898286 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__l0hmqnobk755m9ss9kuupfbjvt8jkhq8kutplrcplvq8tlvf9rq1g0ibpkcmb80o/family1/fccf5d8debd04944aecb67dbdc898286 2023-04-09 15:55:37,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__l0hmqnobk755m9ss9kuupfbjvt8jkhq8kutplrcplvq8tlvf9rq1g0ibpkcmb80o/family1/fccf5d8debd04944aecb67dbdc898286 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/1c0bd37ef62c48d58be7228c1017e436_SeqId_47_ 2023-04-09 15:55:37,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__l0hmqnobk755m9ss9kuupfbjvt8jkhq8kutplrcplvq8tlvf9rq1g0ibpkcmb80o/family1/fccf5d8debd04944aecb67dbdc898286 into 38da5d3a3cb865aa14dc3d24abb615b6/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/1c0bd37ef62c48d58be7228c1017e436_SeqId_47_ - updating store file list. 2023-04-09 15:55:37,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/1c0bd37ef62c48d58be7228c1017e436_SeqId_47_ into 38da5d3a3cb865aa14dc3d24abb615b6/family1 2023-04-09 15:55:37,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__l0hmqnobk755m9ss9kuupfbjvt8jkhq8kutplrcplvq8tlvf9rq1g0ibpkcmb80o/family1/fccf5d8debd04944aecb67dbdc898286 into 38da5d3a3cb865aa14dc3d24abb615b6/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/1c0bd37ef62c48d58be7228c1017e436_SeqId_47_) 2023-04-09 15:55:37,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__l0hmqnobk755m9ss9kuupfbjvt8jkhq8kutplrcplvq8tlvf9rq1g0ibpkcmb80o/family1/fccf5d8debd04944aecb67dbdc898286 2023-04-09 15:55:37,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-04-09 15:55:37,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-04-09 15:55:37,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(1912): 38da5d3a3cb865aa14dc3d24abb615b6/family1 is initiating minor compaction (all files) 2023-04-09 15:55:37,372 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 38da5d3a3cb865aa14dc3d24abb615b6/family1 in testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:37,372 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/3b91997eefb14377969fc37f34bfa5b2, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/eafee78c16a74d1980fe030c0c0c0a00, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/1c0bd37ef62c48d58be7228c1017e436_SeqId_47_] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp, totalSize=178.1 K 2023-04-09 15:55:37,372 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/586e880ec0194a3d958a4dcc35ef1ba1, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/e6aa6a32ba984beeb59d320af7084e01, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/dfb61016b332483b862f7f3ab23f827a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/4142fde4a86445419894f5c302785d6d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/01155ca7ca4f432d8eea0d6b3c76bd3d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/d4fe9d97b6d6453aa2bd4a54a09a4bd8, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/80a1b0f7b53f45ae86779f10c9d48ba6, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/513afddd325843f4aab8be41f09a6708, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/ec5c262628ab45baa44755b342ef2194, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/6a18371b693b4fffa94781a000f7155d_SeqId_44_] to archive 2023-04-09 15:55:37,372 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 3b91997eefb14377969fc37f34bfa5b2, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842473 2023-04-09 15:55:37,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6d02ed98; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:55:37,374 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting eafee78c16a74d1980fe030c0c0c0a00, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242473 2023-04-09 15:55:37,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:37,375 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] compactions.Compactor(207): Compacting 1c0bd37ef62c48d58be7228c1017e436_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965242473 2023-04-09 15:55:37,378 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-04-09 15:55:37,380 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:37,382 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/586e880ec0194a3d958a4dcc35ef1ba1 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/586e880ec0194a3d958a4dcc35ef1ba1 2023-04-09 15:55:37,382 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201ea651854a90a4535ac13f4ffb4396f39 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201ea651854a90a4535ac13f4ffb4396f39 2023-04-09 15:55:37,384 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512050b0d3d03534a476f9e8efb5c3da35e66 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512050b0d3d03534a476f9e8efb5c3da35e66 2023-04-09 15:55:37,386 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512285262500da4c747e08f90f1584bc65d54 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512285262500da4c747e08f90f1584bc65d54 2023-04-09 15:55:37,387 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512312214c206a17c4feba37d2ca5bedccbe4 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512312214c206a17c4feba37d2ca5bedccbe4 2023-04-09 15:55:37,387 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-04-09 15:55:37,388 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-04-09 15:55:37,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/e6aa6a32ba984beeb59d320af7084e01 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/e6aa6a32ba984beeb59d320af7084e01 2023-04-09 15:55:37,388 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-04-09 15:55:37,388 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-04-09 15:55:37,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/dfb61016b332483b862f7f3ab23f827a to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/dfb61016b332483b862f7f3ab23f827a 2023-04-09 15:55:37,392 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/4142fde4a86445419894f5c302785d6d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/4142fde4a86445419894f5c302785d6d 2023-04-09 15:55:37,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/01155ca7ca4f432d8eea0d6b3c76bd3d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/01155ca7ca4f432d8eea0d6b3c76bd3d 2023-04-09 15:55:37,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/d4fe9d97b6d6453aa2bd4a54a09a4bd8 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/d4fe9d97b6d6453aa2bd4a54a09a4bd8 2023-04-09 15:55:37,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/80a1b0f7b53f45ae86779f10c9d48ba6 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/80a1b0f7b53f45ae86779f10c9d48ba6 2023-04-09 15:55:37,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/513afddd325843f4aab8be41f09a6708 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/513afddd325843f4aab8be41f09a6708 2023-04-09 15:55:37,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/ec5c262628ab45baa44755b342ef2194 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/ec5c262628ab45baa44755b342ef2194 2023-04-09 15:55:37,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/6a18371b693b4fffa94781a000f7155d_SeqId_44_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/6a18371b693b4fffa94781a000f7155d_SeqId_44_ 2023-04-09 15:55:37,426 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] throttle.PressureAwareThroughputController(145): 38da5d3a3cb865aa14dc3d24abb615b6#family1#compaction#166 average throughput is 5.98 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-04-09 15:55:37,515 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130081dcac64fb54689961df489d5277aa4 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130081dcac64fb54689961df489d5277aa4 2023-04-09 15:55:37,517 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-04-09 15:55:37,553 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4f92c889f25e4e57b9939b2e690b1838 first=Optional[r00] last=Optional[r8] 2023-04-09 15:55:37,555 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4f92c889f25e4e57b9939b2e690b1838}] 2023-04-09 15:55:37,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4f92c889f25e4e57b9939b2e690b1838 for inclusion in 38da5d3a3cb865aa14dc3d24abb615b6/family1 2023-04-09 15:55:37,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-04-09 15:55:37,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last= 2023-04-09 15:55:37,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for 38da5d3a3cb865aa14dc3d24abb615b6: 2023-04-09 15:55:37,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4f92c889f25e4e57b9939b2e690b1838 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i465hu8cv5alhoh6lsm7ij8hlm1l704plin23d5dhgsc6atb7tmao3rgclirijqi/family1/4f92c889f25e4e57b9939b2e690b1838 2023-04-09 15:55:37,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i465hu8cv5alhoh6lsm7ij8hlm1l704plin23d5dhgsc6atb7tmao3rgclirijqi/family1/4f92c889f25e4e57b9939b2e690b1838 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/7b2ba92608364d0f9c062904b97defdb_SeqId_49_ 2023-04-09 15:55:37,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i465hu8cv5alhoh6lsm7ij8hlm1l704plin23d5dhgsc6atb7tmao3rgclirijqi/family1/4f92c889f25e4e57b9939b2e690b1838 into 38da5d3a3cb865aa14dc3d24abb615b6/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/7b2ba92608364d0f9c062904b97defdb_SeqId_49_ - updating store file list. 2023-04-09 15:55:37,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/7b2ba92608364d0f9c062904b97defdb_SeqId_49_ into 38da5d3a3cb865aa14dc3d24abb615b6/family1 2023-04-09 15:55:37,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i465hu8cv5alhoh6lsm7ij8hlm1l704plin23d5dhgsc6atb7tmao3rgclirijqi/family1/4f92c889f25e4e57b9939b2e690b1838 into 38da5d3a3cb865aa14dc3d24abb615b6/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/7b2ba92608364d0f9c062904b97defdb_SeqId_49_) 2023-04-09 15:55:37,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i465hu8cv5alhoh6lsm7ij8hlm1l704plin23d5dhgsc6atb7tmao3rgclirijqi/family1/4f92c889f25e4e57b9939b2e690b1838 2023-04-09 15:55:37,571 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-04-09 15:55:37,571 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:37,574 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112017b1ab7f2e36475f8c56d769db5f1244 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112017b1ab7f2e36475f8c56d769db5f1244 2023-04-09 15:55:37,575 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128d3aa59cefc134d8f9eb4b028ff00aedc to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128d3aa59cefc134d8f9eb4b028ff00aedc 2023-04-09 15:55:37,577 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113077722ab8f87c4204ab5c8442722bc728 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113077722ab8f87c4204ab5c8442722bc728 2023-04-09 15:55:37,577 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-04-09 15:55:37,577 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-04-09 15:55:37,577 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-04-09 15:55:37,577 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-04-09 15:55:37,577 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-04-09 15:55:37,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-04-09 15:55:37,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:55:37,581 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-04-09 15:55:37,583 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.2790 sec 2023-04-09 15:55:37,911 INFO [Listener at localhost/39283] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=265 (was 251) - Thread LEAK? -, OpenFileDescriptor=652 (was 637) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=443 (was 384) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=1414 (was 1433) 2023-04-09 15:55:37,933 INFO [Listener at localhost/39283] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=265, OpenFileDescriptor=652, MaxFileDescriptor=60000, SystemLoadAverage=443, ProcessCount=169, AvailableMemoryMB=1413 2023-04-09 15:55:37,961 DEBUG [Listener at localhost/39283] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-04-09 15:55:38,035 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xCC\xCF\xE1&\xC2\xE8\xB4\xB2a\x9Ev\x11\xE9|?\x17"\x10Y\x8A\xA2o\xA9\xBE\x94\x9B\xED\x09\x9A#\x97\x17\x19\x88*\x10\xF2\xB47DL\xFD}\x83N3%\xC2H[\x0B\xED2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-04-09 15:55:38,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-04-09 15:55:38,039 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-04-09 15:55:38,040 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-04-09 15:55:38,042 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd 2023-04-09 15:55:38,042 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1 2023-04-09 15:55:38,044 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8 2023-04-09 15:55:38,044 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-04-09 15:55:38,045 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1 empty. 2023-04-09 15:55:38,045 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd empty. 2023-04-09 15:55:38,045 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8 empty. 2023-04-09 15:55:38,045 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1 2023-04-09 15:55:38,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-04-09 15:55:38,045 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd 2023-04-09 15:55:38,046 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8 2023-04-09 15:55:38,046 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-04-09 15:55:38,055 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-04-09 15:55:38,058 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => b21c76b97deec0852a6d87fbf137fbcd, NAME => 'testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xCC\xCF\xE1&\xC2\xE8\xB4\xB2a\x9Ev\x11\xE9|?\x17"\x10Y\x8A\xA2o\xA9\xBE\x94\x9B\xED\x09\x9A#\x97\x17\x19\x88*\x10\xF2\xB47DL\xFD}\x83N3%\xC2H[\x0B\xED2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:55:38,059 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => aa3a6ed259de5fa8a0241a72444f42f8, NAME => 'testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xCC\xCF\xE1&\xC2\xE8\xB4\xB2a\x9Ev\x11\xE9|?\x17"\x10Y\x8A\xA2o\xA9\xBE\x94\x9B\xED\x09\x9A#\x97\x17\x19\x88*\x10\xF2\xB47DL\xFD}\x83N3%\xC2H[\x0B\xED2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:55:38,059 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 378725acb06e17781b58c1e805e455e1, NAME => 'testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xCC\xCF\xE1&\xC2\xE8\xB4\xB2a\x9Ev\x11\xE9|?\x17"\x10Y\x8A\xA2o\xA9\xBE\x94\x9B\xED\x09\x9A#\x97\x17\x19\x88*\x10\xF2\xB47DL\xFD}\x83N3%\xC2H[\x0B\xED2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/.tmp 2023-04-09 15:55:38,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-04-09 15:55:38,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-04-09 15:55:38,473 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:55:38,473 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing b21c76b97deec0852a6d87fbf137fbcd, disabling compactions & flushes 2023-04-09 15:55:38,473 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:38,473 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:38,473 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. after waiting 0 ms 2023-04-09 15:55:38,473 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:38,473 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:38,473 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for b21c76b97deec0852a6d87fbf137fbcd: 2023-04-09 15:55:38,474 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:55:38,474 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:55:38,474 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing aa3a6ed259de5fa8a0241a72444f42f8, disabling compactions & flushes 2023-04-09 15:55:38,474 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 378725acb06e17781b58c1e805e455e1, disabling compactions & flushes 2023-04-09 15:55:38,474 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:38,474 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:38,474 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. after waiting 0 ms 2023-04-09 15:55:38,474 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:38,474 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:38,474 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:38,474 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for aa3a6ed259de5fa8a0241a72444f42f8: 2023-04-09 15:55:38,474 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:38,474 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. after waiting 0 ms 2023-04-09 15:55:38,474 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:38,474 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:38,474 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 378725acb06e17781b58c1e805e455e1: 2023-04-09 15:55:38,477 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-04-09 15:55:38,478 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1681055738478"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055738478"}]},"ts":"1681055738478"} 2023-04-09 15:55:38,479 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1681055738478"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055738478"}]},"ts":"1681055738478"} 2023-04-09 15:55:38,479 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1681055738478"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1681055738478"}]},"ts":"1681055738478"} 2023-04-09 15:55:38,485 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-04-09 15:55:38,486 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-04-09 15:55:38,486 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055738486"}]},"ts":"1681055738486"} 2023-04-09 15:55:38,487 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-04-09 15:55:38,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b21c76b97deec0852a6d87fbf137fbcd, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=378725acb06e17781b58c1e805e455e1, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=aa3a6ed259de5fa8a0241a72444f42f8, ASSIGN}] 2023-04-09 15:55:38,492 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=aa3a6ed259de5fa8a0241a72444f42f8, ASSIGN 2023-04-09 15:55:38,492 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=378725acb06e17781b58c1e805e455e1, ASSIGN 2023-04-09 15:55:38,492 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b21c76b97deec0852a6d87fbf137fbcd, ASSIGN 2023-04-09 15:55:38,493 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=aa3a6ed259de5fa8a0241a72444f42f8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:55:38,493 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=378725acb06e17781b58c1e805e455e1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:55:38,493 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b21c76b97deec0852a6d87fbf137fbcd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44869,1681055618167; forceNewPlan=false, retain=false 2023-04-09 15:55:38,645 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=b21c76b97deec0852a6d87fbf137fbcd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:38,645 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=aa3a6ed259de5fa8a0241a72444f42f8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:38,645 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1681055738645"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055738645"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055738645"}]},"ts":"1681055738645"} 2023-04-09 15:55:38,645 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=378725acb06e17781b58c1e805e455e1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:38,646 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1681055738645"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055738645"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055738645"}]},"ts":"1681055738645"} 2023-04-09 15:55:38,645 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1681055738645"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1681055738645"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1681055738645"}]},"ts":"1681055738645"} 2023-04-09 15:55:38,647 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure b21c76b97deec0852a6d87fbf137fbcd, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:55:38,648 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure 378725acb06e17781b58c1e805e455e1, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:55:38,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-04-09 15:55:38,649 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure aa3a6ed259de5fa8a0241a72444f42f8, server=jenkins-hbase4.apache.org,44869,1681055618167}] 2023-04-09 15:55:38,690 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/.tmp/family1/2a0a297f555a46129091f469d1191c32 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/2a0a297f555a46129091f469d1191c32 2023-04-09 15:55:38,697 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 38da5d3a3cb865aa14dc3d24abb615b6/family1 of 38da5d3a3cb865aa14dc3d24abb615b6 into 2a0a297f555a46129091f469d1191c32(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-09 15:55:38,697 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 38da5d3a3cb865aa14dc3d24abb615b6: 2023-04-09 15:55:38,697 INFO [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1681055737371; duration=1sec 2023-04-09 15:55:38,698 DEBUG [RS:0;jenkins-hbase4:44869-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-04-09 15:55:38,776 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/3b91997eefb14377969fc37f34bfa5b2, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/eafee78c16a74d1980fe030c0c0c0a00, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/1c0bd37ef62c48d58be7228c1017e436_SeqId_47_] to archive 2023-04-09 15:55:38,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:38,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/3b91997eefb14377969fc37f34bfa5b2 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/3b91997eefb14377969fc37f34bfa5b2 2023-04-09 15:55:38,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/eafee78c16a74d1980fe030c0c0c0a00 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/eafee78c16a74d1980fe030c0c0c0a00 2023-04-09 15:55:38,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/1c0bd37ef62c48d58be7228c1017e436_SeqId_47_ to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/family1/1c0bd37ef62c48d58be7228c1017e436_SeqId_47_ 2023-04-09 15:55:38,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:38,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 378725acb06e17781b58c1e805e455e1, NAME => 'testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1.', STARTKEY => '1', ENDKEY => '2'} 2023-04-09 15:55:38,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 378725acb06e17781b58c1e805e455e1 2023-04-09 15:55:38,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:55:38,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 378725acb06e17781b58c1e805e455e1 2023-04-09 15:55:38,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 378725acb06e17781b58c1e805e455e1 2023-04-09 15:55:38,832 INFO [StoreOpener-378725acb06e17781b58c1e805e455e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 378725acb06e17781b58c1e805e455e1 2023-04-09 15:55:38,834 DEBUG [StoreOpener-378725acb06e17781b58c1e805e455e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1 2023-04-09 15:55:38,834 DEBUG [StoreOpener-378725acb06e17781b58c1e805e455e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1 2023-04-09 15:55:38,834 INFO [StoreOpener-378725acb06e17781b58c1e805e455e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 378725acb06e17781b58c1e805e455e1 columnFamilyName family1 2023-04-09 15:55:38,838 INFO [StoreOpener-378725acb06e17781b58c1e805e455e1-1] regionserver.HStore(310): Store=378725acb06e17781b58c1e805e455e1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:38,839 INFO [StoreOpener-378725acb06e17781b58c1e805e455e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 378725acb06e17781b58c1e805e455e1 2023-04-09 15:55:38,840 DEBUG [StoreOpener-378725acb06e17781b58c1e805e455e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2 2023-04-09 15:55:38,840 DEBUG [StoreOpener-378725acb06e17781b58c1e805e455e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2 2023-04-09 15:55:38,841 INFO [StoreOpener-378725acb06e17781b58c1e805e455e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 378725acb06e17781b58c1e805e455e1 columnFamilyName family2 2023-04-09 15:55:38,843 INFO [StoreOpener-378725acb06e17781b58c1e805e455e1-1] regionserver.HStore(310): Store=378725acb06e17781b58c1e805e455e1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:38,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1 2023-04-09 15:55:38,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1 2023-04-09 15:55:38,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-09 15:55:38,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 378725acb06e17781b58c1e805e455e1 2023-04-09 15:55:38,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:55:38,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 378725acb06e17781b58c1e805e455e1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66180011, jitterRate=-0.013840988278388977}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-09 15:55:38,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 378725acb06e17781b58c1e805e455e1: 2023-04-09 15:55:38,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1., pid=121, masterSystemTime=1681055738799 2023-04-09 15:55:38,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:38,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:38,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:38,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b21c76b97deec0852a6d87fbf137fbcd, NAME => 'testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd.', STARTKEY => '', ENDKEY => '1'} 2023-04-09 15:55:38,852 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=378725acb06e17781b58c1e805e455e1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:38,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin b21c76b97deec0852a6d87fbf137fbcd 2023-04-09 15:55:38,852 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1681055738851"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055738851"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055738851"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055738851"}]},"ts":"1681055738851"} 2023-04-09 15:55:38,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:55:38,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b21c76b97deec0852a6d87fbf137fbcd 2023-04-09 15:55:38,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b21c76b97deec0852a6d87fbf137fbcd 2023-04-09 15:55:38,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=118 2023-04-09 15:55:38,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure 378725acb06e17781b58c1e805e455e1, server=jenkins-hbase4.apache.org,44869,1681055618167 in 205 msec 2023-04-09 15:55:38,856 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=378725acb06e17781b58c1e805e455e1, ASSIGN in 365 msec 2023-04-09 15:55:38,892 INFO [StoreOpener-b21c76b97deec0852a6d87fbf137fbcd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b21c76b97deec0852a6d87fbf137fbcd 2023-04-09 15:55:38,894 DEBUG [StoreOpener-b21c76b97deec0852a6d87fbf137fbcd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1 2023-04-09 15:55:38,894 DEBUG [StoreOpener-b21c76b97deec0852a6d87fbf137fbcd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1 2023-04-09 15:55:38,894 INFO [StoreOpener-b21c76b97deec0852a6d87fbf137fbcd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b21c76b97deec0852a6d87fbf137fbcd columnFamilyName family1 2023-04-09 15:55:38,895 INFO [StoreOpener-b21c76b97deec0852a6d87fbf137fbcd-1] regionserver.HStore(310): Store=b21c76b97deec0852a6d87fbf137fbcd/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:38,895 INFO [StoreOpener-b21c76b97deec0852a6d87fbf137fbcd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b21c76b97deec0852a6d87fbf137fbcd 2023-04-09 15:55:38,897 DEBUG [StoreOpener-b21c76b97deec0852a6d87fbf137fbcd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2 2023-04-09 15:55:38,897 DEBUG [StoreOpener-b21c76b97deec0852a6d87fbf137fbcd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2 2023-04-09 15:55:38,897 INFO [StoreOpener-b21c76b97deec0852a6d87fbf137fbcd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b21c76b97deec0852a6d87fbf137fbcd columnFamilyName family2 2023-04-09 15:55:38,898 INFO [StoreOpener-b21c76b97deec0852a6d87fbf137fbcd-1] regionserver.HStore(310): Store=b21c76b97deec0852a6d87fbf137fbcd/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:38,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd 2023-04-09 15:55:38,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd 2023-04-09 15:55:38,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-09 15:55:38,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b21c76b97deec0852a6d87fbf137fbcd 2023-04-09 15:55:38,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:55:38,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b21c76b97deec0852a6d87fbf137fbcd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72570472, jitterRate=0.08138430118560791}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-09 15:55:38,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b21c76b97deec0852a6d87fbf137fbcd: 2023-04-09 15:55:38,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd., pid=120, masterSystemTime=1681055738799 2023-04-09 15:55:38,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:38,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:38,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:38,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aa3a6ed259de5fa8a0241a72444f42f8, NAME => 'testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8.', STARTKEY => '2', ENDKEY => ''} 2023-04-09 15:55:38,920 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=b21c76b97deec0852a6d87fbf137fbcd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:38,920 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1681055738920"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055738920"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055738920"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055738920"}]},"ts":"1681055738920"} 2023-04-09 15:55:38,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin aa3a6ed259de5fa8a0241a72444f42f8 2023-04-09 15:55:38,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-04-09 15:55:38,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for aa3a6ed259de5fa8a0241a72444f42f8 2023-04-09 15:55:38,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for aa3a6ed259de5fa8a0241a72444f42f8 2023-04-09 15:55:38,923 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=117 2023-04-09 15:55:38,923 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure b21c76b97deec0852a6d87fbf137fbcd, server=jenkins-hbase4.apache.org,44869,1681055618167 in 274 msec 2023-04-09 15:55:38,924 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b21c76b97deec0852a6d87fbf137fbcd, ASSIGN in 433 msec 2023-04-09 15:55:38,975 INFO [StoreOpener-aa3a6ed259de5fa8a0241a72444f42f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region aa3a6ed259de5fa8a0241a72444f42f8 2023-04-09 15:55:38,978 DEBUG [StoreOpener-aa3a6ed259de5fa8a0241a72444f42f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1 2023-04-09 15:55:38,978 DEBUG [StoreOpener-aa3a6ed259de5fa8a0241a72444f42f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1 2023-04-09 15:55:38,979 INFO [StoreOpener-aa3a6ed259de5fa8a0241a72444f42f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa3a6ed259de5fa8a0241a72444f42f8 columnFamilyName family1 2023-04-09 15:55:38,981 INFO [StoreOpener-aa3a6ed259de5fa8a0241a72444f42f8-1] regionserver.HStore(310): Store=aa3a6ed259de5fa8a0241a72444f42f8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:38,981 INFO [StoreOpener-aa3a6ed259de5fa8a0241a72444f42f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region aa3a6ed259de5fa8a0241a72444f42f8 2023-04-09 15:55:38,992 DEBUG [StoreOpener-aa3a6ed259de5fa8a0241a72444f42f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2 2023-04-09 15:55:38,992 DEBUG [StoreOpener-aa3a6ed259de5fa8a0241a72444f42f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2 2023-04-09 15:55:38,993 INFO [StoreOpener-aa3a6ed259de5fa8a0241a72444f42f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa3a6ed259de5fa8a0241a72444f42f8 columnFamilyName family2 2023-04-09 15:55:38,994 INFO [StoreOpener-aa3a6ed259de5fa8a0241a72444f42f8-1] regionserver.HStore(310): Store=aa3a6ed259de5fa8a0241a72444f42f8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-04-09 15:55:38,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8 2023-04-09 15:55:38,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8 2023-04-09 15:55:38,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-04-09 15:55:39,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for aa3a6ed259de5fa8a0241a72444f42f8 2023-04-09 15:55:39,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-04-09 15:55:39,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened aa3a6ed259de5fa8a0241a72444f42f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75303569, jitterRate=0.12211062014102936}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-04-09 15:55:39,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for aa3a6ed259de5fa8a0241a72444f42f8: 2023-04-09 15:55:39,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8., pid=122, masterSystemTime=1681055738799 2023-04-09 15:55:39,016 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=aa3a6ed259de5fa8a0241a72444f42f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:39,016 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1681055739016"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1681055739016"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1681055739016"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1681055739016"}]},"ts":"1681055739016"} 2023-04-09 15:55:39,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:39,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:39,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=119 2023-04-09 15:55:39,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure aa3a6ed259de5fa8a0241a72444f42f8, server=jenkins-hbase4.apache.org,44869,1681055618167 in 369 msec 2023-04-09 15:55:39,021 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=119, resume processing ppid=116 2023-04-09 15:55:39,021 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=aa3a6ed259de5fa8a0241a72444f42f8, ASSIGN in 529 msec 2023-04-09 15:55:39,021 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-04-09 15:55:39,022 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1681055739021"}]},"ts":"1681055739021"} 2023-04-09 15:55:39,023 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-04-09 15:55:39,025 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-04-09 15:55:39,026 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 989 msec 2023-04-09 15:55:39,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-04-09 15:55:39,151 INFO [Listener at localhost/39283] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-04-09 15:55:39,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:39,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:39,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:39,162 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:39,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-04-09 15:55:39,164 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-04-09 15:55:39,164 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:39,164 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-04-09 15:55:39,164 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-04-09 15:55:39,165 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:39,165 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:39,168 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:39,168 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:39,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:39,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:39,169 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:39,169 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:39,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:39,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:39,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:39,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:39,170 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-04-09 15:55:39,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-04-09 15:55:39,170 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-04-09 15:55:39,170 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:39,170 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-04-09 15:55:39,172 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:39,173 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. started... 2023-04-09 15:55:39,197 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:39,197 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b21c76b97deec0852a6d87fbf137fbcd 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-04-09 15:55:39,197 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. started... 2023-04-09 15:55:39,200 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-09 15:55:39,200 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:39,205 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 378725acb06e17781b58c1e805e455e1 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-04-09 15:55:39,205 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:39,205 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. started... 2023-04-09 15:55:39,206 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing aa3a6ed259de5fa8a0241a72444f42f8 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-04-09 15:55:39,337 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409cde93ac6aadd4dda89f4230f77fbe30b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230409cde93ac6aadd4dda89f4230f77fbe30b 2023-04-09 15:55:39,337 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230409be219be61b3e48318e5af1bd6384c111 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230409be219be61b3e48318e5af1bd6384c111 2023-04-09 15:55:39,754 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409e85218f82fef4de2b20b681baf0a2c48 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230409e85218f82fef4de2b20b681baf0a2c48 2023-04-09 15:55:39,779 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family1/764855e49138422ba6ec19995883aece 2023-04-09 15:55:39,789 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family1/9caff355e70347bf906816385fd81901 2023-04-09 15:55:39,849 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304097acf957663dc476795a9e682b02eba9d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202304097acf957663dc476795a9e682b02eba9d 2023-04-09 15:55:39,867 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family2/506fbe512c8944149e5ccd9dc032d414 2023-04-09 15:55:39,871 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023040956067ca6556f46b19e34d4e61642cfba to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023040956067ca6556f46b19e34d4e61642cfba 2023-04-09 15:55:39,874 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family1/764855e49138422ba6ec19995883aece as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/764855e49138422ba6ec19995883aece 2023-04-09 15:55:39,880 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family2/8289aadd1876492fa41e3357ca2a4510 2023-04-09 15:55:39,884 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family1/9caff355e70347bf906816385fd81901 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/9caff355e70347bf906816385fd81901 2023-04-09 15:55:39,905 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/764855e49138422ba6ec19995883aece, entries=4, sequenceid=5, filesize=5.5 K 2023-04-09 15:55:39,906 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family2/506fbe512c8944149e5ccd9dc032d414 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/506fbe512c8944149e5ccd9dc032d414 2023-04-09 15:55:39,909 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/506fbe512c8944149e5ccd9dc032d414, entries=2, sequenceid=5, filesize=5.1 K 2023-04-09 15:55:39,909 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 378725acb06e17781b58c1e805e455e1 in 705ms, sequenceid=5, compaction requested=false 2023-04-09 15:55:39,909 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-04-09 15:55:39,910 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 378725acb06e17781b58c1e805e455e1: 2023-04-09 15:55:39,910 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:39,910 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-09 15:55:39,918 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/9caff355e70347bf906816385fd81901, entries=4, sequenceid=5, filesize=5.5 K 2023-04-09 15:55:39,918 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family2/8289aadd1876492fa41e3357ca2a4510 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/8289aadd1876492fa41e3357ca2a4510 2023-04-09 15:55:39,921 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/8289aadd1876492fa41e3357ca2a4510, entries=2, sequenceid=5, filesize=5.1 K 2023-04-09 15:55:39,922 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b21c76b97deec0852a6d87fbf137fbcd in 725ms, sequenceid=5, compaction requested=false 2023-04-09 15:55:39,923 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b21c76b97deec0852a6d87fbf137fbcd: 2023-04-09 15:55:39,923 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:39,923 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-09 15:55:40,216 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family1/edc7bc033a0f4c2a96c2ce7837466136 2023-04-09 15:55:40,646 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409eb944f5cfafc4f2e88c0272f8f452b3e to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230409eb944f5cfafc4f2e88c0272f8f452b3e 2023-04-09 15:55:41,051 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family2/0bdda32fd23445a7b07b6f2d02d8553d 2023-04-09 15:55:41,054 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family1/edc7bc033a0f4c2a96c2ce7837466136 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/edc7bc033a0f4c2a96c2ce7837466136 2023-04-09 15:55:41,077 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/edc7bc033a0f4c2a96c2ce7837466136, entries=4, sequenceid=5, filesize=5.5 K 2023-04-09 15:55:41,078 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family2/0bdda32fd23445a7b07b6f2d02d8553d as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/0bdda32fd23445a7b07b6f2d02d8553d 2023-04-09 15:55:41,080 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/0bdda32fd23445a7b07b6f2d02d8553d, entries=2, sequenceid=5, filesize=5.1 K 2023-04-09 15:55:41,081 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for aa3a6ed259de5fa8a0241a72444f42f8 in 1875ms, sequenceid=5, compaction requested=false 2023-04-09 15:55:41,081 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for aa3a6ed259de5fa8a0241a72444f42f8: 2023-04-09 15:55:41,081 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:41,081 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-09 15:55:41,081 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-09 15:55:41,081 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:41,081 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-04-09 15:55:41,081 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-04-09 15:55:41,083 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:41,083 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:41,084 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:41,084 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:41,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:41,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-04-09 15:55:41,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@293ca04a[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:41,085 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-04-09 15:55:41,085 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:41,086 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:41,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:41,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:41,086 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-04-09 15:55:41,086 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-04-09 15:55:41,086 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:41,086 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:41,086 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:41,087 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-04-09 15:55:41,087 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-04-09 15:55:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:41,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:41,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:41,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:41,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:41,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-04-09 15:55:41,089 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-04-09 15:55:41,089 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:41,090 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:41,090 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-04-09 15:55:41,090 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:41,091 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:41,091 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:41,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:41,091 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:41,091 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:41,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:41,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:41,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:41,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:41,092 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:41,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:41,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:41,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:41,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:41,095 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:41,095 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:41,095 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:41,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:41,095 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-04-09 15:55:41,095 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:41,095 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:41,095 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:41,095 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:41,095 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:41,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:41,095 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:41,095 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:41,095 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:41,095 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:41,095 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:41,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:41,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:41,195 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:41,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:41,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:41,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:41,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:41,199 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:41,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-04-09 15:55:41,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-04-09 15:55:41,201 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-04-09 15:55:41,201 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:41,201 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-04-09 15:55:41,201 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-04-09 15:55:41,202 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:41,202 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:41,203 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:41,203 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:41,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:41,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:41,204 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:41,204 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:41,204 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:41,204 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-04-09 15:55:41,205 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-04-09 15:55:41,205 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-04-09 15:55:41,205 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-04-09 15:55:41,205 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:41,205 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-04-09 15:55:41,205 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:41,205 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. started... 2023-04-09 15:55:41,205 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-09 15:55:41,205 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:41,205 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b21c76b97deec0852a6d87fbf137fbcd 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-04-09 15:55:41,205 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:41,205 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. started... 2023-04-09 15:55:41,205 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:41,205 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. started... 2023-04-09 15:55:41,205 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 378725acb06e17781b58c1e805e455e1 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-04-09 15:55:41,205 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing aa3a6ed259de5fa8a0241a72444f42f8 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-04-09 15:55:41,646 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023040929cc093693b342b09de37a752fda2a1b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023040929cc093693b342b09de37a752fda2a1b 2023-04-09 15:55:41,655 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409792a0a527309445f85b812e4a3139b71 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230409792a0a527309445f85b812e4a3139b71 2023-04-09 15:55:41,655 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023040984b9040ad11e48e3ac8d7b15bb0a3f07 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023040984b9040ad11e48e3ac8d7b15bb0a3f07 2023-04-09 15:55:42,060 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family1/bd3ccdee14ad457a85ba4b698628cc90 2023-04-09 15:55:42,069 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family1/d7a2b6c1000f46e69f826f1a418d3cdd 2023-04-09 15:55:42,070 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family1/9fed1354f1cd41c4a367aceb242ceb1a 2023-04-09 15:55:42,110 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304091cd7b25dc2c24ebe9f9b6b65fda1895d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202304091cd7b25dc2c24ebe9f9b6b65fda1895d 2023-04-09 15:55:42,493 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202304095219a28760c64a01bc9d999117e4d232 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202304095219a28760c64a01bc9d999117e4d232 2023-04-09 15:55:42,510 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409ada695c6c40e4d0ea7e858fd6915db9a to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230409ada695c6c40e4d0ea7e858fd6915db9a 2023-04-09 15:55:42,514 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family2/cd0c5ec0083d4e00bae8adc40c2c539b 2023-04-09 15:55:42,514 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family2/c5a24674accf444c85e3ed98daa240fe 2023-04-09 15:55:42,517 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family1/9fed1354f1cd41c4a367aceb242ceb1a as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/9fed1354f1cd41c4a367aceb242ceb1a 2023-04-09 15:55:42,517 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family1/d7a2b6c1000f46e69f826f1a418d3cdd as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/d7a2b6c1000f46e69f826f1a418d3cdd 2023-04-09 15:55:42,539 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/d7a2b6c1000f46e69f826f1a418d3cdd, entries=4, sequenceid=9, filesize=5.5 K 2023-04-09 15:55:42,539 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/9fed1354f1cd41c4a367aceb242ceb1a, entries=4, sequenceid=9, filesize=5.5 K 2023-04-09 15:55:42,540 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family2/c5a24674accf444c85e3ed98daa240fe as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/c5a24674accf444c85e3ed98daa240fe 2023-04-09 15:55:42,540 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family2/cd0c5ec0083d4e00bae8adc40c2c539b as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/cd0c5ec0083d4e00bae8adc40c2c539b 2023-04-09 15:55:42,543 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/c5a24674accf444c85e3ed98daa240fe, entries=2, sequenceid=9, filesize=5.1 K 2023-04-09 15:55:42,543 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/cd0c5ec0083d4e00bae8adc40c2c539b, entries=2, sequenceid=9, filesize=5.1 K 2023-04-09 15:55:42,543 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b21c76b97deec0852a6d87fbf137fbcd in 1338ms, sequenceid=9, compaction requested=false 2023-04-09 15:55:42,543 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for aa3a6ed259de5fa8a0241a72444f42f8 in 1338ms, sequenceid=9, compaction requested=false 2023-04-09 15:55:42,544 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b21c76b97deec0852a6d87fbf137fbcd: 2023-04-09 15:55:42,544 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for aa3a6ed259de5fa8a0241a72444f42f8: 2023-04-09 15:55:42,544 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:42,544 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:42,544 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-09 15:55:42,544 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-09 15:55:42,897 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family2/2425c44b933b47c892d0584847129054 2023-04-09 15:55:42,901 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family1/bd3ccdee14ad457a85ba4b698628cc90 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/bd3ccdee14ad457a85ba4b698628cc90 2023-04-09 15:55:42,923 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/bd3ccdee14ad457a85ba4b698628cc90, entries=4, sequenceid=9, filesize=5.5 K 2023-04-09 15:55:42,924 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family2/2425c44b933b47c892d0584847129054 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/2425c44b933b47c892d0584847129054 2023-04-09 15:55:42,927 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/2425c44b933b47c892d0584847129054, entries=2, sequenceid=9, filesize=5.1 K 2023-04-09 15:55:42,927 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 378725acb06e17781b58c1e805e455e1 in 1722ms, sequenceid=9, compaction requested=false 2023-04-09 15:55:42,928 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 378725acb06e17781b58c1e805e455e1: 2023-04-09 15:55:42,928 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:42,928 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-09 15:55:42,928 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-09 15:55:42,928 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:42,928 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-04-09 15:55:42,928 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-04-09 15:55:42,929 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:42,929 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:42,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:42,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:42,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:42,930 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:42,930 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:42,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:42,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:42,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:42,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:42,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:42,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-04-09 15:55:42,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21afc96[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:42,931 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-04-09 15:55:42,931 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:42,932 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:42,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:42,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:42,932 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-04-09 15:55:42,932 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-04-09 15:55:42,932 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:42,932 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:42,932 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:42,937 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-04-09 15:55:42,937 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:42,937 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:42,937 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-04-09 15:55:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:42,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:42,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:42,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:42,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:42,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:42,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:42,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-04-09 15:55:42,939 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-04-09 15:55:42,939 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:42,939 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:42,939 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-04-09 15:55:42,939 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:42,940 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:42,940 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:42,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:42,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:42,940 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:42,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:42,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:42,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:42,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:42,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:42,941 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:42,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:42,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:42,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:42,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:42,942 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:42,944 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:42,944 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:42,944 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:42,944 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:42,944 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:42,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:42,944 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-04-09 15:55:42,944 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:42,944 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:42,944 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:42,944 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:42,944 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:42,944 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:42,945 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:42,945 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:42,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:43,045 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:43,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:43,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:43,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:43,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:43,050 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:43,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-04-09 15:55:43,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-04-09 15:55:43,053 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-04-09 15:55:43,053 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:43,053 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-04-09 15:55:43,053 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-04-09 15:55:43,053 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:43,053 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:43,054 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:43,054 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:43,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:43,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:43,055 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:43,055 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:43,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:43,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:43,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:43,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:43,056 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-04-09 15:55:43,056 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-04-09 15:55:43,056 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-04-09 15:55:43,056 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-04-09 15:55:43,056 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:43,056 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-04-09 15:55:43,063 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:43,063 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. started... 2023-04-09 15:55:43,063 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:43,063 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b21c76b97deec0852a6d87fbf137fbcd 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-04-09 15:55:43,063 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-09 15:55:43,063 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:43,063 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. started... 2023-04-09 15:55:43,063 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. started... 2023-04-09 15:55:43,063 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:43,064 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing aa3a6ed259de5fa8a0241a72444f42f8 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-04-09 15:55:43,064 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 378725acb06e17781b58c1e805e455e1 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-04-09 15:55:43,126 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409fd8e37f7bde1490197e1671ed23f172c to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230409fd8e37f7bde1490197e1671ed23f172c 2023-04-09 15:55:43,141 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family1/a06585b5804d42e0b12149ce5dafec63 2023-04-09 15:55:43,506 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023040931472dbb8eca4642919732ad4a3e5c9e to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023040931472dbb8eca4642919732ad4a3e5c9e 2023-04-09 15:55:43,519 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230409504ccc63fc564fca86b349a0c98c2025 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230409504ccc63fc564fca86b349a0c98c2025 2023-04-09 15:55:43,573 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409e361b69506b34048a51e9ae2851efd18 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230409e361b69506b34048a51e9ae2851efd18 2023-04-09 15:55:43,920 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family1/b6a4eae47fb14a0393fa5e9d5479dfcf 2023-04-09 15:55:43,935 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family1/0c285e904ccb49f7813333f4b8a16d97 2023-04-09 15:55:43,977 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family2/16038755c9b7459eae961efc56b46ea8 2023-04-09 15:55:43,981 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family1/a06585b5804d42e0b12149ce5dafec63 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/a06585b5804d42e0b12149ce5dafec63 2023-04-09 15:55:44,003 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/a06585b5804d42e0b12149ce5dafec63, entries=4, sequenceid=13, filesize=5.5 K 2023-04-09 15:55:44,004 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family2/16038755c9b7459eae961efc56b46ea8 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/16038755c9b7459eae961efc56b46ea8 2023-04-09 15:55:44,007 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/16038755c9b7459eae961efc56b46ea8, entries=2, sequenceid=13, filesize=5.1 K 2023-04-09 15:55:44,008 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for aa3a6ed259de5fa8a0241a72444f42f8 in 943ms, sequenceid=13, compaction requested=true 2023-04-09 15:55:44,008 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for aa3a6ed259de5fa8a0241a72444f42f8: 2023-04-09 15:55:44,008 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:44,008 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-09 15:55:44,304 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-04-09 15:55:44,358 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023040931dc09e52ddf4fdb86938d33fa0851bc to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023040931dc09e52ddf4fdb86938d33fa0851bc 2023-04-09 15:55:44,361 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family2/66641c31714b465baf3f8082f67b2d84 2023-04-09 15:55:44,364 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023040920374bdf529345f1ab4fc340f1a4cdf9 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023040920374bdf529345f1ab4fc340f1a4cdf9 2023-04-09 15:55:44,365 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family1/b6a4eae47fb14a0393fa5e9d5479dfcf as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/b6a4eae47fb14a0393fa5e9d5479dfcf 2023-04-09 15:55:44,388 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/b6a4eae47fb14a0393fa5e9d5479dfcf, entries=4, sequenceid=13, filesize=5.5 K 2023-04-09 15:55:44,388 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family2/66641c31714b465baf3f8082f67b2d84 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/66641c31714b465baf3f8082f67b2d84 2023-04-09 15:55:44,391 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/66641c31714b465baf3f8082f67b2d84, entries=2, sequenceid=13, filesize=5.1 K 2023-04-09 15:55:44,392 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b21c76b97deec0852a6d87fbf137fbcd in 1329ms, sequenceid=13, compaction requested=true 2023-04-09 15:55:44,392 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b21c76b97deec0852a6d87fbf137fbcd: 2023-04-09 15:55:44,392 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:44,392 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-09 15:55:44,769 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family2/1833eedef62c44bc88274cae162c6513 2023-04-09 15:55:44,772 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family1/0c285e904ccb49f7813333f4b8a16d97 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/0c285e904ccb49f7813333f4b8a16d97 2023-04-09 15:55:44,796 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/0c285e904ccb49f7813333f4b8a16d97, entries=4, sequenceid=13, filesize=5.5 K 2023-04-09 15:55:44,796 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family2/1833eedef62c44bc88274cae162c6513 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/1833eedef62c44bc88274cae162c6513 2023-04-09 15:55:44,800 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/1833eedef62c44bc88274cae162c6513, entries=2, sequenceid=13, filesize=5.1 K 2023-04-09 15:55:44,800 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 378725acb06e17781b58c1e805e455e1 in 1736ms, sequenceid=13, compaction requested=true 2023-04-09 15:55:44,800 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 378725acb06e17781b58c1e805e455e1: 2023-04-09 15:55:44,800 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:44,800 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-09 15:55:44,800 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-09 15:55:44,800 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:44,801 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-04-09 15:55:44,801 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-04-09 15:55:44,802 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:44,802 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:44,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:44,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:44,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:44,802 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:44,802 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:44,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:44,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:44,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:44,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:44,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:44,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-04-09 15:55:44,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b6acd2f[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:44,803 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-04-09 15:55:44,803 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:44,805 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:44,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:44,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:44,806 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-04-09 15:55:44,806 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:44,806 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:44,806 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-04-09 15:55:44,806 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:44,807 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-04-09 15:55:44,807 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:44,807 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:44,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:44,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:44,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:44,807 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-04-09 15:55:44,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:44,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:44,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:44,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:44,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:44,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:44,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:44,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:44,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-04-09 15:55:44,809 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-04-09 15:55:44,809 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:44,809 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:44,809 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-04-09 15:55:44,809 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:44,810 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:44,810 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:44,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:44,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:44,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:44,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:44,810 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:44,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:44,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:44,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:44,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:44,811 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:44,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:44,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:44,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:44,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:44,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:44,812 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:44,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:44,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:44,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:44,814 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:44,814 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:44,814 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:44,814 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:44,814 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:44,814 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-04-09 15:55:44,814 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:44,814 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:44,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:44,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:44,814 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:44,814 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:44,814 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:44,814 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:44,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:44,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:44,815 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:44,815 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:44,915 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:44,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:44,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:44,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:44,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. with WAL disabled. Data may be lost in the event of a crash. 2023-04-09 15:55:44,919 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:44,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-04-09 15:55:44,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-04-09 15:55:44,921 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-04-09 15:55:44,921 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:44,921 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-04-09 15:55:44,921 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-04-09 15:55:44,921 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:44,921 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:44,926 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:44,926 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:44,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:44,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:44,926 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:44,926 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:44,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:44,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:44,927 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-04-09 15:55:44,927 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-04-09 15:55:44,927 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-04-09 15:55:44,927 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-04-09 15:55:44,927 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:44,927 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-04-09 15:55:44,927 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:44,928 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-09 15:55:44,928 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:44,928 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:44,928 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:44,928 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. started... 2023-04-09 15:55:44,928 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. started... 2023-04-09 15:55:44,928 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. started... 2023-04-09 15:55:44,928 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 378725acb06e17781b58c1e805e455e1 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-04-09 15:55:44,928 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing aa3a6ed259de5fa8a0241a72444f42f8 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-04-09 15:55:44,928 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b21c76b97deec0852a6d87fbf137fbcd 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-04-09 15:55:44,971 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409e4c5e229514d41a4add95720c9d6d1c6 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230409e4c5e229514d41a4add95720c9d6d1c6 2023-04-09 15:55:45,368 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023040900970e6d8e584fe1a3612ec675b0f4ea to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023040900970e6d8e584fe1a3612ec675b0f4ea 2023-04-09 15:55:45,368 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230409eaad53744f6a45c890641152bc2eb614 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230409eaad53744f6a45c890641152bc2eb614 2023-04-09 15:55:45,384 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family1/8c7778bd323d4128832b0a3afe0dd4f7 2023-04-09 15:55:45,782 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family1/5cf4697dde2b4790a5c484b88d5decbb 2023-04-09 15:55:45,784 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family1/735b7c8de6dc4c2c8964b848d8c984a5 2023-04-09 15:55:45,813 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409204696cc80194909bd9209aa36053b90 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230409204696cc80194909bd9209aa36053b90 2023-04-09 15:55:45,816 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family2/83f325212c4d44f1a84b1ef85112a79a 2023-04-09 15:55:45,819 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family1/8c7778bd323d4128832b0a3afe0dd4f7 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/8c7778bd323d4128832b0a3afe0dd4f7 2023-04-09 15:55:45,842 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/8c7778bd323d4128832b0a3afe0dd4f7, entries=4, sequenceid=17, filesize=5.5 K 2023-04-09 15:55:45,842 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family2/83f325212c4d44f1a84b1ef85112a79a as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/83f325212c4d44f1a84b1ef85112a79a 2023-04-09 15:55:45,845 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/83f325212c4d44f1a84b1ef85112a79a, entries=2, sequenceid=17, filesize=5.1 K 2023-04-09 15:55:45,846 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b21c76b97deec0852a6d87fbf137fbcd in 917ms, sequenceid=17, compaction requested=true 2023-04-09 15:55:45,846 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b21c76b97deec0852a6d87fbf137fbcd: 2023-04-09 15:55:45,846 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:45,846 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-09 15:55:46,214 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304099ad98a199ccd4590b4b9fdb9f7793b15 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202304099ad98a199ccd4590b4b9fdb9f7793b15 2023-04-09 15:55:46,214 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230409a062c5361fd14fd78bbcb1fd29e6a79b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230409a062c5361fd14fd78bbcb1fd29e6a79b 2023-04-09 15:55:46,220 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family2/bac02e404fce4ea08ca726d3e52c8bde 2023-04-09 15:55:46,220 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family2/a2a30f9b665440c4914fba2259a8dac4 2023-04-09 15:55:46,223 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family1/5cf4697dde2b4790a5c484b88d5decbb as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/5cf4697dde2b4790a5c484b88d5decbb 2023-04-09 15:55:46,224 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family1/735b7c8de6dc4c2c8964b848d8c984a5 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/735b7c8de6dc4c2c8964b848d8c984a5 2023-04-09 15:55:46,246 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/735b7c8de6dc4c2c8964b848d8c984a5, entries=4, sequenceid=17, filesize=5.5 K 2023-04-09 15:55:46,247 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/5cf4697dde2b4790a5c484b88d5decbb, entries=4, sequenceid=17, filesize=5.5 K 2023-04-09 15:55:46,247 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family2/a2a30f9b665440c4914fba2259a8dac4 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/a2a30f9b665440c4914fba2259a8dac4 2023-04-09 15:55:46,247 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family2/bac02e404fce4ea08ca726d3e52c8bde as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/bac02e404fce4ea08ca726d3e52c8bde 2023-04-09 15:55:46,251 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/a2a30f9b665440c4914fba2259a8dac4, entries=2, sequenceid=17, filesize=5.1 K 2023-04-09 15:55:46,251 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/bac02e404fce4ea08ca726d3e52c8bde, entries=2, sequenceid=17, filesize=5.1 K 2023-04-09 15:55:46,252 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 378725acb06e17781b58c1e805e455e1 in 1324ms, sequenceid=17, compaction requested=true 2023-04-09 15:55:46,252 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for aa3a6ed259de5fa8a0241a72444f42f8 in 1324ms, sequenceid=17, compaction requested=true 2023-04-09 15:55:46,252 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 378725acb06e17781b58c1e805e455e1: 2023-04-09 15:55:46,252 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for aa3a6ed259de5fa8a0241a72444f42f8: 2023-04-09 15:55:46,252 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:46,252 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:46,252 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-09 15:55:46,253 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-09 15:55:46,253 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-09 15:55:46,253 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:46,253 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-04-09 15:55:46,253 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-04-09 15:55:46,254 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:46,254 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:46,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:46,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:46,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:46,254 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:46,254 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:46,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:46,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:46,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:46,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:46,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:46,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-04-09 15:55:46,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20c61705[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:46,256 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-04-09 15:55:46,256 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:46,257 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:46,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:46,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:46,257 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-04-09 15:55:46,257 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-04-09 15:55:46,257 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:46,257 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:46,257 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:46,259 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:46,259 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-04-09 15:55:46,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:46,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:46,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:46,259 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:46,259 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-04-09 15:55:46,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:46,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:46,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:46,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:46,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:46,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:46,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:46,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:46,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-04-09 15:55:46,261 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-04-09 15:55:46,261 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:46,261 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:46,261 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-04-09 15:55:46,261 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:46,262 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:46,262 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:46,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:46,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:46,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:46,262 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:46,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:46,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:46,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:46,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:46,262 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:46,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:46,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:46,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:46,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:46,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:46,264 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:46,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:46,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:46,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:46,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:46,265 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:46,265 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:46,266 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:46,266 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:46,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:46,266 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-04-09 15:55:46,266 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:46,266 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:46,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-04-09 15:55:46,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:46,266 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:46,266 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:46,266 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:46,266 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:46,266 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:46,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:46,266 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:46,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:46,266 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:46,366 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:46,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:46,375 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:46,380 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:46,386 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:46,387 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:46,430 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-09 15:55:46,430 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4111bddc to 127.0.0.1:64813 2023-04-09 15:55:46,430 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:55:46,487 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-04-09 15:55:46,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-04-09 15:55:46,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-04-09 15:55:46,489 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-04-09 15:55:46,489 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:46,489 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-04-09 15:55:46,489 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-04-09 15:55:46,489 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:46,490 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:46,491 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:46,491 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:46,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:46,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:46,491 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:46,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:46,491 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-04-09 15:55:46,491 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:46,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-04-09 15:55:46,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:46,492 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-04-09 15:55:46,496 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-04-09 15:55:46,496 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-04-09 15:55:46,496 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-04-09 15:55:46,496 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-04-09 15:55:46,498 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:46,498 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. started... 2023-04-09 15:55:46,498 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:46,498 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b21c76b97deec0852a6d87fbf137fbcd 2/2 column families, dataSize=138 B heapSize=944 B 2023-04-09 15:55:46,498 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-04-09 15:55:46,498 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:46,498 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. started... 2023-04-09 15:55:46,498 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. started... 2023-04-09 15:55:46,498 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-04-09 15:55:46,498 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing aa3a6ed259de5fa8a0241a72444f42f8 2/2 column families, dataSize=138 B heapSize=944 B 2023-04-09 15:55:46,498 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 378725acb06e17781b58c1e805e455e1 2/2 column families, dataSize=138 B heapSize=944 B 2023-04-09 15:55:46,556 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family1/53d49cba8ff747f68148b21ba20119be 2023-04-09 15:55:46,583 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 53d49cba8ff747f68148b21ba20119be 2023-04-09 15:55:46,993 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family2/ebeed618dfde4b02af945e20533b942f 2023-04-09 15:55:46,996 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebeed618dfde4b02af945e20533b942f 2023-04-09 15:55:46,997 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family1/53d49cba8ff747f68148b21ba20119be as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/53d49cba8ff747f68148b21ba20119be 2023-04-09 15:55:47,019 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 53d49cba8ff747f68148b21ba20119be 2023-04-09 15:55:47,019 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/53d49cba8ff747f68148b21ba20119be, entries=3, sequenceid=23, filesize=5.2 K 2023-04-09 15:55:47,020 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family2/ebeed618dfde4b02af945e20533b942f as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/ebeed618dfde4b02af945e20533b942f 2023-04-09 15:55:47,023 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebeed618dfde4b02af945e20533b942f 2023-04-09 15:55:47,023 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/ebeed618dfde4b02af945e20533b942f, entries=1, sequenceid=23, filesize=5.0 K 2023-04-09 15:55:47,024 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 378725acb06e17781b58c1e805e455e1 in 526ms, sequenceid=23, compaction requested=true 2023-04-09 15:55:47,024 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 378725acb06e17781b58c1e805e455e1: 2023-04-09 15:55:47,024 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:47,024 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-04-09 15:55:47,354 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family1/b539aadcb67147d8a956184f3c65200e 2023-04-09 15:55:47,354 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family1/3d172cba6b2c49fb8a05692cdf340c98 2023-04-09 15:55:47,376 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3d172cba6b2c49fb8a05692cdf340c98 2023-04-09 15:55:47,376 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b539aadcb67147d8a956184f3c65200e 2023-04-09 15:55:47,791 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family2/1a92d33fd86741fc8296360846ac8322 2023-04-09 15:55:47,791 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family2/52e152de284347adac7ba8644d6f4edf 2023-04-09 15:55:47,794 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a92d33fd86741fc8296360846ac8322 2023-04-09 15:55:47,794 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 52e152de284347adac7ba8644d6f4edf 2023-04-09 15:55:47,794 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family1/b539aadcb67147d8a956184f3c65200e as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/b539aadcb67147d8a956184f3c65200e 2023-04-09 15:55:47,794 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family1/3d172cba6b2c49fb8a05692cdf340c98 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/3d172cba6b2c49fb8a05692cdf340c98 2023-04-09 15:55:47,817 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3d172cba6b2c49fb8a05692cdf340c98 2023-04-09 15:55:47,817 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b539aadcb67147d8a956184f3c65200e 2023-04-09 15:55:47,817 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/3d172cba6b2c49fb8a05692cdf340c98, entries=3, sequenceid=23, filesize=5.2 K 2023-04-09 15:55:47,817 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/b539aadcb67147d8a956184f3c65200e, entries=3, sequenceid=23, filesize=5.2 K 2023-04-09 15:55:47,818 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family2/52e152de284347adac7ba8644d6f4edf as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/52e152de284347adac7ba8644d6f4edf 2023-04-09 15:55:47,818 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family2/1a92d33fd86741fc8296360846ac8322 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/1a92d33fd86741fc8296360846ac8322 2023-04-09 15:55:47,821 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 52e152de284347adac7ba8644d6f4edf 2023-04-09 15:55:47,821 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/52e152de284347adac7ba8644d6f4edf, entries=1, sequenceid=23, filesize=5.0 K 2023-04-09 15:55:47,821 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a92d33fd86741fc8296360846ac8322 2023-04-09 15:55:47,821 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/1a92d33fd86741fc8296360846ac8322, entries=1, sequenceid=23, filesize=5.0 K 2023-04-09 15:55:47,821 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b21c76b97deec0852a6d87fbf137fbcd in 1323ms, sequenceid=23, compaction requested=true 2023-04-09 15:55:47,822 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b21c76b97deec0852a6d87fbf137fbcd: 2023-04-09 15:55:47,822 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:47,822 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-04-09 15:55:47,822 INFO [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for aa3a6ed259de5fa8a0241a72444f42f8 in 1324ms, sequenceid=23, compaction requested=true 2023-04-09 15:55:47,822 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for aa3a6ed259de5fa8a0241a72444f42f8: 2023-04-09 15:55:47,822 DEBUG [rs(jenkins-hbase4.apache.org,44869,1681055618167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:47,822 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-04-09 15:55:47,822 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-04-09 15:55:47,822 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:47,822 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-04-09 15:55:47,822 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-04-09 15:55:47,823 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:47,823 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:47,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:47,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:47,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:47,824 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:47,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:47,824 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-04-09 15:55:47,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:47,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:47,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:47,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:47,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44869,1681055618167' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-04-09 15:55:47,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c34dda7[Count = 0] remaining members to acquire global barrier 2023-04-09 15:55:47,825 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-04-09 15:55:47,825 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:47,826 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:47,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:47,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:47,826 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-04-09 15:55:47,826 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-04-09 15:55:47,826 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,44869,1681055618167' in zk 2023-04-09 15:55:47,826 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:47,826 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-04-09 15:55:47,827 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-04-09 15:55:47,827 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:47,827 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:47,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:47,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:47,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:47,827 DEBUG [member: 'jenkins-hbase4.apache.org,44869,1681055618167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-04-09 15:55:47,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:47,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:47,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:47,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:47,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:47,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:47,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:47,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,44869,1681055618167': 2023-04-09 15:55:47,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44869,1681055618167' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-04-09 15:55:47,830 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-04-09 15:55:47,830 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-04-09 15:55:47,830 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-04-09 15:55:47,830 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-04-09 15:55:47,830 INFO [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-04-09 15:55:47,832 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:47,832 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:47,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:47,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:47,832 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:47,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:47,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-04-09 15:55:47,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-04-09 15:55:47,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:47,832 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:47,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-04-09 15:55:47,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:47,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:47,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:47,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-04-09 15:55:47,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:47,833 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:47,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:47,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-04-09 15:55:47,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-04-09 15:55:47,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:47,835 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:47,835 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-04-09 15:55:47,835 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:47,835 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-04-09 15:55:47,835 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-04-09 15:55:47,835 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-04-09 15:55:47,835 DEBUG [(jenkins-hbase4.apache.org,33617,1681055616968)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-04-09 15:55:47,835 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-04-09 15:55:47,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-04-09 15:55:47,836 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:47,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-04-09 15:55:47,836 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:47,836 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-04-09 15:55:47,836 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-04-09 15:55:47,836 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-04-09 15:55:47,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-04-09 15:55:47,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-04-09 15:55:47,836 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-04-09 15:55:47,936 DEBUG [Listener at localhost/39283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-04-09 15:55:47,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33617] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-04-09 15:55:47,937 DEBUG [Listener at localhost/39283] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:47,937 DEBUG [Listener at localhost/39283] regionserver.HStore(1912): b21c76b97deec0852a6d87fbf137fbcd/family1 is initiating major compaction (all files) 2023-04-09 15:55:47,937 INFO [Listener at localhost/39283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:55:47,937 INFO [Listener at localhost/39283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:55:47,939 INFO [Listener at localhost/39283] regionserver.HRegion(2259): Starting compaction of b21c76b97deec0852a6d87fbf137fbcd/family1 in testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:47,939 INFO [Listener at localhost/39283] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/9caff355e70347bf906816385fd81901, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/d7a2b6c1000f46e69f826f1a418d3cdd, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/b6a4eae47fb14a0393fa5e9d5479dfcf, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/8c7778bd323d4128832b0a3afe0dd4f7, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/3d172cba6b2c49fb8a05692cdf340c98] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp, totalSize=27.1 K 2023-04-09 15:55:47,940 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 9caff355e70347bf906816385fd81901, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055739159 2023-04-09 15:55:47,940 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting d7a2b6c1000f46e69f826f1a418d3cdd, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055741197 2023-04-09 15:55:47,940 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting b6a4eae47fb14a0393fa5e9d5479dfcf, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055743047 2023-04-09 15:55:47,941 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 8c7778bd323d4128832b0a3afe0dd4f7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055744917 2023-04-09 15:55:47,941 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 3d172cba6b2c49fb8a05692cdf340c98, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-09 15:55:47,949 INFO [Listener at localhost/39283] throttle.PressureAwareThroughputController(145): b21c76b97deec0852a6d87fbf137fbcd#family1#compaction#197 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:55:48,384 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230409b6439862ad854a3b9a61513d29683b91_del 2023-04-09 15:55:48,385 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409b6439862ad854a3b9a61513d29683b91_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230409b6439862ad854a3b9a61513d29683b91_del 2023-04-09 15:55:49,253 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c8417552b65c4b878f2cb5ab4b76ac6e 2023-04-09 15:55:49,254 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family1/c8417552b65c4b878f2cb5ab4b76ac6e as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/c8417552b65c4b878f2cb5ab4b76ac6e 2023-04-09 15:55:49,284 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c8417552b65c4b878f2cb5ab4b76ac6e 2023-04-09 15:55:49,285 INFO [Listener at localhost/39283] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b21c76b97deec0852a6d87fbf137fbcd/family1 of b21c76b97deec0852a6d87fbf137fbcd into c8417552b65c4b878f2cb5ab4b76ac6e(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-04-09 15:55:49,285 DEBUG [Listener at localhost/39283] regionserver.HRegion(2289): Compaction status journal for b21c76b97deec0852a6d87fbf137fbcd: 2023-04-09 15:55:49,286 DEBUG [Listener at localhost/39283] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:49,286 DEBUG [Listener at localhost/39283] regionserver.HStore(1912): b21c76b97deec0852a6d87fbf137fbcd/family2 is initiating major compaction (all files) 2023-04-09 15:55:49,286 INFO [Listener at localhost/39283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:55:49,286 INFO [Listener at localhost/39283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:55:49,286 INFO [Listener at localhost/39283] regionserver.HRegion(2259): Starting compaction of b21c76b97deec0852a6d87fbf137fbcd/family2 in testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:49,286 INFO [Listener at localhost/39283] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/8289aadd1876492fa41e3357ca2a4510, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/c5a24674accf444c85e3ed98daa240fe, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/66641c31714b465baf3f8082f67b2d84, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/83f325212c4d44f1a84b1ef85112a79a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/52e152de284347adac7ba8644d6f4edf] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp, totalSize=25.4 K 2023-04-09 15:55:49,287 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 8289aadd1876492fa41e3357ca2a4510, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055739159 2023-04-09 15:55:49,287 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting c5a24674accf444c85e3ed98daa240fe, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055741197 2023-04-09 15:55:49,288 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 66641c31714b465baf3f8082f67b2d84, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055743047 2023-04-09 15:55:49,288 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 83f325212c4d44f1a84b1ef85112a79a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055744917 2023-04-09 15:55:49,288 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 52e152de284347adac7ba8644d6f4edf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-09 15:55:49,296 INFO [Listener at localhost/39283] throttle.PressureAwareThroughputController(145): b21c76b97deec0852a6d87fbf137fbcd#family2#compaction#198 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:55:49,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/9caff355e70347bf906816385fd81901, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/d7a2b6c1000f46e69f826f1a418d3cdd, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/b6a4eae47fb14a0393fa5e9d5479dfcf, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/8c7778bd323d4128832b0a3afe0dd4f7, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/3d172cba6b2c49fb8a05692cdf340c98] to archive 2023-04-09 15:55:49,371 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:49,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/9caff355e70347bf906816385fd81901 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/9caff355e70347bf906816385fd81901 2023-04-09 15:55:49,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/d7a2b6c1000f46e69f826f1a418d3cdd to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/d7a2b6c1000f46e69f826f1a418d3cdd 2023-04-09 15:55:49,375 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/b6a4eae47fb14a0393fa5e9d5479dfcf to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/b6a4eae47fb14a0393fa5e9d5479dfcf 2023-04-09 15:55:49,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/8c7778bd323d4128832b0a3afe0dd4f7 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/8c7778bd323d4128832b0a3afe0dd4f7 2023-04-09 15:55:49,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/3d172cba6b2c49fb8a05692cdf340c98 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/3d172cba6b2c49fb8a05692cdf340c98 2023-04-09 15:55:49,709 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202304095487633e48a24c468c696ff944fe4c43_del 2023-04-09 15:55:49,709 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202304095487633e48a24c468c696ff944fe4c43_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202304095487633e48a24c468c696ff944fe4c43_del 2023-04-09 15:55:49,721 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92b3ad0517124f0ba1621546881e65b8 2023-04-09 15:55:49,722 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/.tmp/family2/92b3ad0517124f0ba1621546881e65b8 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/92b3ad0517124f0ba1621546881e65b8 2023-04-09 15:55:49,726 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92b3ad0517124f0ba1621546881e65b8 2023-04-09 15:55:49,727 INFO [Listener at localhost/39283] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b21c76b97deec0852a6d87fbf137fbcd/family2 of b21c76b97deec0852a6d87fbf137fbcd into 92b3ad0517124f0ba1621546881e65b8(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:55:49,727 DEBUG [Listener at localhost/39283] regionserver.HRegion(2289): Compaction status journal for b21c76b97deec0852a6d87fbf137fbcd: 2023-04-09 15:55:49,727 DEBUG [Listener at localhost/39283] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:49,727 DEBUG [Listener at localhost/39283] regionserver.HStore(1912): 378725acb06e17781b58c1e805e455e1/family1 is initiating major compaction (all files) 2023-04-09 15:55:49,727 INFO [Listener at localhost/39283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:55:49,728 INFO [Listener at localhost/39283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:55:49,728 INFO [Listener at localhost/39283] regionserver.HRegion(2259): Starting compaction of 378725acb06e17781b58c1e805e455e1/family1 in testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:49,728 INFO [Listener at localhost/39283] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/764855e49138422ba6ec19995883aece, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/bd3ccdee14ad457a85ba4b698628cc90, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/0c285e904ccb49f7813333f4b8a16d97, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/735b7c8de6dc4c2c8964b848d8c984a5, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/53d49cba8ff747f68148b21ba20119be] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp, totalSize=27.1 K 2023-04-09 15:55:49,728 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 764855e49138422ba6ec19995883aece, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055739160 2023-04-09 15:55:49,729 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting bd3ccdee14ad457a85ba4b698628cc90, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055741197 2023-04-09 15:55:49,729 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 0c285e904ccb49f7813333f4b8a16d97, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055743048 2023-04-09 15:55:49,729 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 735b7c8de6dc4c2c8964b848d8c984a5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055744917 2023-04-09 15:55:49,730 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 53d49cba8ff747f68148b21ba20119be, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-09 15:55:49,737 INFO [Listener at localhost/39283] throttle.PressureAwareThroughputController(145): 378725acb06e17781b58c1e805e455e1#family1#compaction#199 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:55:49,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/8289aadd1876492fa41e3357ca2a4510, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/c5a24674accf444c85e3ed98daa240fe, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/66641c31714b465baf3f8082f67b2d84, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/83f325212c4d44f1a84b1ef85112a79a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/52e152de284347adac7ba8644d6f4edf] to archive 2023-04-09 15:55:49,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:49,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/8289aadd1876492fa41e3357ca2a4510 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/8289aadd1876492fa41e3357ca2a4510 2023-04-09 15:55:49,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/c5a24674accf444c85e3ed98daa240fe to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/c5a24674accf444c85e3ed98daa240fe 2023-04-09 15:55:49,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/66641c31714b465baf3f8082f67b2d84 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/66641c31714b465baf3f8082f67b2d84 2023-04-09 15:55:49,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/83f325212c4d44f1a84b1ef85112a79a to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/83f325212c4d44f1a84b1ef85112a79a 2023-04-09 15:55:49,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/52e152de284347adac7ba8644d6f4edf to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family2/52e152de284347adac7ba8644d6f4edf 2023-04-09 15:55:49,791 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230409a09932862d554c39a3d30f352c29b226_del 2023-04-09 15:55:49,791 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230409a09932862d554c39a3d30f352c29b226_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230409a09932862d554c39a3d30f352c29b226_del 2023-04-09 15:55:49,862 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88c8ab09cf424b29b0cedaa10889470d 2023-04-09 15:55:49,863 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family1/88c8ab09cf424b29b0cedaa10889470d as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/88c8ab09cf424b29b0cedaa10889470d 2023-04-09 15:55:49,894 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88c8ab09cf424b29b0cedaa10889470d 2023-04-09 15:55:49,895 INFO [Listener at localhost/39283] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 378725acb06e17781b58c1e805e455e1/family1 of 378725acb06e17781b58c1e805e455e1 into 88c8ab09cf424b29b0cedaa10889470d(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:55:49,895 DEBUG [Listener at localhost/39283] regionserver.HRegion(2289): Compaction status journal for 378725acb06e17781b58c1e805e455e1: 2023-04-09 15:55:49,895 DEBUG [Listener at localhost/39283] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:49,895 DEBUG [Listener at localhost/39283] regionserver.HStore(1912): 378725acb06e17781b58c1e805e455e1/family2 is initiating major compaction (all files) 2023-04-09 15:55:49,896 INFO [Listener at localhost/39283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:55:49,896 INFO [Listener at localhost/39283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:55:49,896 INFO [Listener at localhost/39283] regionserver.HRegion(2259): Starting compaction of 378725acb06e17781b58c1e805e455e1/family2 in testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:49,896 INFO [Listener at localhost/39283] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/506fbe512c8944149e5ccd9dc032d414, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/2425c44b933b47c892d0584847129054, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/1833eedef62c44bc88274cae162c6513, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/a2a30f9b665440c4914fba2259a8dac4, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/ebeed618dfde4b02af945e20533b942f] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp, totalSize=25.4 K 2023-04-09 15:55:49,897 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 506fbe512c8944149e5ccd9dc032d414, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055739160 2023-04-09 15:55:49,897 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 2425c44b933b47c892d0584847129054, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055741197 2023-04-09 15:55:49,897 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 1833eedef62c44bc88274cae162c6513, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055743048 2023-04-09 15:55:49,898 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting a2a30f9b665440c4914fba2259a8dac4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055744917 2023-04-09 15:55:49,898 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting ebeed618dfde4b02af945e20533b942f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-09 15:55:49,908 INFO [Listener at localhost/39283] throttle.PressureAwareThroughputController(145): 378725acb06e17781b58c1e805e455e1#family2#compaction#200 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:55:49,919 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230409d31beccafc9b4c039fbaebba79da5325_del 2023-04-09 15:55:49,919 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230409d31beccafc9b4c039fbaebba79da5325_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230409d31beccafc9b4c039fbaebba79da5325_del 2023-04-09 15:55:49,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/764855e49138422ba6ec19995883aece, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/bd3ccdee14ad457a85ba4b698628cc90, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/0c285e904ccb49f7813333f4b8a16d97, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/735b7c8de6dc4c2c8964b848d8c984a5, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/53d49cba8ff747f68148b21ba20119be] to archive 2023-04-09 15:55:49,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:49,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/764855e49138422ba6ec19995883aece to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/764855e49138422ba6ec19995883aece 2023-04-09 15:55:49,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/bd3ccdee14ad457a85ba4b698628cc90 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/bd3ccdee14ad457a85ba4b698628cc90 2023-04-09 15:55:49,976 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/0c285e904ccb49f7813333f4b8a16d97 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/0c285e904ccb49f7813333f4b8a16d97 2023-04-09 15:55:49,977 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/735b7c8de6dc4c2c8964b848d8c984a5 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/735b7c8de6dc4c2c8964b848d8c984a5 2023-04-09 15:55:49,978 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/53d49cba8ff747f68148b21ba20119be to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/53d49cba8ff747f68148b21ba20119be 2023-04-09 15:55:50,340 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 903a54650f0d49ed96cc20895ee258c0 2023-04-09 15:55:50,341 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/.tmp/family2/903a54650f0d49ed96cc20895ee258c0 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/903a54650f0d49ed96cc20895ee258c0 2023-04-09 15:55:50,344 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 903a54650f0d49ed96cc20895ee258c0 2023-04-09 15:55:50,345 INFO [Listener at localhost/39283] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 378725acb06e17781b58c1e805e455e1/family2 of 378725acb06e17781b58c1e805e455e1 into 903a54650f0d49ed96cc20895ee258c0(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:55:50,345 DEBUG [Listener at localhost/39283] regionserver.HRegion(2289): Compaction status journal for 378725acb06e17781b58c1e805e455e1: 2023-04-09 15:55:50,345 DEBUG [Listener at localhost/39283] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:50,346 DEBUG [Listener at localhost/39283] regionserver.HStore(1912): aa3a6ed259de5fa8a0241a72444f42f8/family1 is initiating major compaction (all files) 2023-04-09 15:55:50,346 INFO [Listener at localhost/39283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:55:50,346 INFO [Listener at localhost/39283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:55:50,347 INFO [Listener at localhost/39283] regionserver.HRegion(2259): Starting compaction of aa3a6ed259de5fa8a0241a72444f42f8/family1 in testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:50,347 INFO [Listener at localhost/39283] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/edc7bc033a0f4c2a96c2ce7837466136, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/9fed1354f1cd41c4a367aceb242ceb1a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/a06585b5804d42e0b12149ce5dafec63, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/5cf4697dde2b4790a5c484b88d5decbb, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/b539aadcb67147d8a956184f3c65200e] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp, totalSize=27.1 K 2023-04-09 15:55:50,347 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting edc7bc033a0f4c2a96c2ce7837466136, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055739160 2023-04-09 15:55:50,348 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 9fed1354f1cd41c4a367aceb242ceb1a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055741197 2023-04-09 15:55:50,348 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting a06585b5804d42e0b12149ce5dafec63, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055743048 2023-04-09 15:55:50,348 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 5cf4697dde2b4790a5c484b88d5decbb, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055744917 2023-04-09 15:55:50,349 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting b539aadcb67147d8a956184f3c65200e, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-09 15:55:50,358 INFO [Listener at localhost/39283] throttle.PressureAwareThroughputController(145): aa3a6ed259de5fa8a0241a72444f42f8#family1#compaction#201 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:55:50,372 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/506fbe512c8944149e5ccd9dc032d414, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/2425c44b933b47c892d0584847129054, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/1833eedef62c44bc88274cae162c6513, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/a2a30f9b665440c4914fba2259a8dac4, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/ebeed618dfde4b02af945e20533b942f] to archive 2023-04-09 15:55:50,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:50,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/506fbe512c8944149e5ccd9dc032d414 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/506fbe512c8944149e5ccd9dc032d414 2023-04-09 15:55:50,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/2425c44b933b47c892d0584847129054 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/2425c44b933b47c892d0584847129054 2023-04-09 15:55:50,379 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/1833eedef62c44bc88274cae162c6513 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/1833eedef62c44bc88274cae162c6513 2023-04-09 15:55:50,382 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/a2a30f9b665440c4914fba2259a8dac4 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/a2a30f9b665440c4914fba2259a8dac4 2023-04-09 15:55:50,385 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/ebeed618dfde4b02af945e20533b942f to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family2/ebeed618dfde4b02af945e20533b942f 2023-04-09 15:55:50,410 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202304096502e141b276406f9cf9e7b7ce3b6cc4_del 2023-04-09 15:55:50,410 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304096502e141b276406f9cf9e7b7ce3b6cc4_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202304096502e141b276406f9cf9e7b7ce3b6cc4_del 2023-04-09 15:55:50,473 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6715f9df5b314228b3dfe1709021229c 2023-04-09 15:55:50,473 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family1/6715f9df5b314228b3dfe1709021229c as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/6715f9df5b314228b3dfe1709021229c 2023-04-09 15:55:50,504 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6715f9df5b314228b3dfe1709021229c 2023-04-09 15:55:50,505 INFO [Listener at localhost/39283] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in aa3a6ed259de5fa8a0241a72444f42f8/family1 of aa3a6ed259de5fa8a0241a72444f42f8 into 6715f9df5b314228b3dfe1709021229c(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:55:50,505 DEBUG [Listener at localhost/39283] regionserver.HRegion(2289): Compaction status journal for aa3a6ed259de5fa8a0241a72444f42f8: 2023-04-09 15:55:50,505 DEBUG [Listener at localhost/39283] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-04-09 15:55:50,505 DEBUG [Listener at localhost/39283] regionserver.HStore(1912): aa3a6ed259de5fa8a0241a72444f42f8/family2 is initiating major compaction (all files) 2023-04-09 15:55:50,506 INFO [Listener at localhost/39283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-04-09 15:55:50,506 INFO [Listener at localhost/39283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-04-09 15:55:50,506 INFO [Listener at localhost/39283] regionserver.HRegion(2259): Starting compaction of aa3a6ed259de5fa8a0241a72444f42f8/family2 in testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:50,506 INFO [Listener at localhost/39283] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/0bdda32fd23445a7b07b6f2d02d8553d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/cd0c5ec0083d4e00bae8adc40c2c539b, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/16038755c9b7459eae961efc56b46ea8, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/bac02e404fce4ea08ca726d3e52c8bde, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/1a92d33fd86741fc8296360846ac8322] into tmpdir=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp, totalSize=25.4 K 2023-04-09 15:55:50,506 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 0bdda32fd23445a7b07b6f2d02d8553d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1681055739160 2023-04-09 15:55:50,507 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting cd0c5ec0083d4e00bae8adc40c2c539b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1681055741197 2023-04-09 15:55:50,507 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 16038755c9b7459eae961efc56b46ea8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1681055743048 2023-04-09 15:55:50,507 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting bac02e404fce4ea08ca726d3e52c8bde, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1681055744917 2023-04-09 15:55:50,508 DEBUG [Listener at localhost/39283] compactions.Compactor(207): Compacting 1a92d33fd86741fc8296360846ac8322, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-04-09 15:55:50,520 INFO [Listener at localhost/39283] throttle.PressureAwareThroughputController(145): aa3a6ed259de5fa8a0241a72444f42f8#family2#compaction#202 average throughput is 0.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-04-09 15:55:50,527 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202304098c386b4643a441819a058da034aca2c1_del 2023-04-09 15:55:50,527 INFO [Listener at localhost/39283] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202304098c386b4643a441819a058da034aca2c1_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202304098c386b4643a441819a058da034aca2c1_del 2023-04-09 15:55:50,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/edc7bc033a0f4c2a96c2ce7837466136, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/9fed1354f1cd41c4a367aceb242ceb1a, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/a06585b5804d42e0b12149ce5dafec63, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/5cf4697dde2b4790a5c484b88d5decbb, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/b539aadcb67147d8a956184f3c65200e] to archive 2023-04-09 15:55:50,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:50,576 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/edc7bc033a0f4c2a96c2ce7837466136 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/edc7bc033a0f4c2a96c2ce7837466136 2023-04-09 15:55:50,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/9fed1354f1cd41c4a367aceb242ceb1a to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/9fed1354f1cd41c4a367aceb242ceb1a 2023-04-09 15:55:50,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/a06585b5804d42e0b12149ce5dafec63 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/a06585b5804d42e0b12149ce5dafec63 2023-04-09 15:55:50,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/5cf4697dde2b4790a5c484b88d5decbb to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/5cf4697dde2b4790a5c484b88d5decbb 2023-04-09 15:55:50,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/b539aadcb67147d8a956184f3c65200e to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/b539aadcb67147d8a956184f3c65200e 2023-04-09 15:55:51,340 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 09bf909824bf4182a797187be123f42f 2023-04-09 15:55:51,341 DEBUG [Listener at localhost/39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/.tmp/family2/09bf909824bf4182a797187be123f42f as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/09bf909824bf4182a797187be123f42f 2023-04-09 15:55:51,344 INFO [Listener at localhost/39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 09bf909824bf4182a797187be123f42f 2023-04-09 15:55:51,345 INFO [Listener at localhost/39283] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in aa3a6ed259de5fa8a0241a72444f42f8/family2 of aa3a6ed259de5fa8a0241a72444f42f8 into 09bf909824bf4182a797187be123f42f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-04-09 15:55:51,346 DEBUG [Listener at localhost/39283] regionserver.HRegion(2289): Compaction status journal for aa3a6ed259de5fa8a0241a72444f42f8: 2023-04-09 15:55:51,350 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:51,353 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:51,357 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:51,358 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:51,364 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33617] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xCC\xCF\xE1&\xC2\xE8\xB4\xB2a\x9Ev\x11\xE9|?\x17"\x10Y\x8A\xA2o\xA9\xBE\x94\x9B\xED\x09\x9A#\x97\x17\x19\x88*\x10\xF2\xB47DL\xFD}\x83N3%\xC2H[\x0B\xED2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-04-09 15:55:51,371 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/0bdda32fd23445a7b07b6f2d02d8553d, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/cd0c5ec0083d4e00bae8adc40c2c539b, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/16038755c9b7459eae961efc56b46ea8, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/bac02e404fce4ea08ca726d3e52c8bde, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/1a92d33fd86741fc8296360846ac8322] to archive 2023-04-09 15:55:51,371 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:51,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/0bdda32fd23445a7b07b6f2d02d8553d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/0bdda32fd23445a7b07b6f2d02d8553d 2023-04-09 15:55:51,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/cd0c5ec0083d4e00bae8adc40c2c539b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/cd0c5ec0083d4e00bae8adc40c2c539b 2023-04-09 15:55:51,375 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/16038755c9b7459eae961efc56b46ea8 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/16038755c9b7459eae961efc56b46ea8 2023-04-09 15:55:51,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/bac02e404fce4ea08ca726d3e52c8bde to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/bac02e404fce4ea08ca726d3e52c8bde 2023-04-09 15:55:51,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/1a92d33fd86741fc8296360846ac8322 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family2/1a92d33fd86741fc8296360846ac8322 2023-04-09 15:55:51,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-04-09 15:55:51,395 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-04-09 15:55:51,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:55:51,396 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1681056351396 2023-04-09 15:55:51,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-04-09 15:55:51,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-04-09 15:55:51,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230409b6439862ad854a3b9a61513d29683b91_del 2023-04-09 15:55:51,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230409a09932862d554c39a3d30f352c29b226_del 2023-04-09 15:55:51,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202304096502e141b276406f9cf9e7b7ce3b6cc4_del 2023-04-09 15:55:51,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-04-09 15:55:51,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] zookeeper.ReadOnlyZKClient(139): Connect 0x2521dec5 to 127.0.0.1:64813 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-04-09 15:55:51,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fb8294a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-04-09 15:55:51,904 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230409 for table='testMajorCompactionFromAdmin' and column='family1' 2023-04-09 15:55:52,089 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230409b3ec746fc5c74b2182cbc74520acd10b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230409b3ec746fc5c74b2182cbc74520acd10b 2023-04-09 15:55:52,091 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230409 table='testMajorCompactionFromAdmin' column='family1' 2023-04-09 15:55:52,102 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-04-09 15:55:52,105 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57362, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-04-09 15:55:52,113 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-04-09 15:55:52,115 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42134, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-04-09 15:55:52,147 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230409/family1/d4bd7fa8e97445b8a1df8c3ef46b8c6b first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-04-09 15:55:52,148 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230409/family1/d4bd7fa8e97445b8a1df8c3ef46b8c6b}] 2023-04-09 15:55:52,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230409/family1/d4bd7fa8e97445b8a1df8c3ef46b8c6b for inclusion in 378725acb06e17781b58c1e805e455e1/family1 2023-04-09 15:55:52,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-04-09 15:55:52,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(777): Region bounds: first=1 last=2 2023-04-09 15:55:52,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for 378725acb06e17781b58c1e805e455e1: 2023-04-09 15:55:52,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230409/family1/d4bd7fa8e97445b8a1df8c3ef46b8c6b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionFromAdmin__h87svig2med2fr2t404u30d4tnm3kv0tjujadh4lg6gj2e3jvrglqaojdmlekogu/family1/d4bd7fa8e97445b8a1df8c3ef46b8c6b 2023-04-09 15:55:52,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionFromAdmin__h87svig2med2fr2t404u30d4tnm3kv0tjujadh4lg6gj2e3jvrglqaojdmlekogu/family1/d4bd7fa8e97445b8a1df8c3ef46b8c6b as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/333a121a80954ed684ab972dd7e902b6_SeqId_28_ 2023-04-09 15:55:52,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionFromAdmin__h87svig2med2fr2t404u30d4tnm3kv0tjujadh4lg6gj2e3jvrglqaojdmlekogu/family1/d4bd7fa8e97445b8a1df8c3ef46b8c6b into 378725acb06e17781b58c1e805e455e1/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/333a121a80954ed684ab972dd7e902b6_SeqId_28_ - updating store file list. 2023-04-09 15:55:52,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/333a121a80954ed684ab972dd7e902b6_SeqId_28_ into 378725acb06e17781b58c1e805e455e1/family1 2023-04-09 15:55:52,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionFromAdmin__h87svig2med2fr2t404u30d4tnm3kv0tjujadh4lg6gj2e3jvrglqaojdmlekogu/family1/d4bd7fa8e97445b8a1df8c3ef46b8c6b into 378725acb06e17781b58c1e805e455e1/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/family1/333a121a80954ed684ab972dd7e902b6_SeqId_28_) 2023-04-09 15:55:52,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionFromAdmin__h87svig2med2fr2t404u30d4tnm3kv0tjujadh4lg6gj2e3jvrglqaojdmlekogu/family1/d4bd7fa8e97445b8a1df8c3ef46b8c6b 2023-04-09 15:55:52,212 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230409 table='testMajorCompactionFromAdmin' column='family1' 2023-04-09 15:55:52,213 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:52,215 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023040929cc093693b342b09de37a752fda2a1b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023040929cc093693b342b09de37a752fda2a1b 2023-04-09 15:55:52,216 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230409504ccc63fc564fca86b349a0c98c2025 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230409504ccc63fc564fca86b349a0c98c2025 2023-04-09 15:55:52,217 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230409be219be61b3e48318e5af1bd6384c111 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230409be219be61b3e48318e5af1bd6384c111 2023-04-09 15:55:52,219 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230409eaad53744f6a45c890641152bc2eb614 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230409eaad53744f6a45c890641152bc2eb614 2023-04-09 15:55:52,219 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-04-09 15:55:52,219 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230409' 2023-04-09 15:55:52,220 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230409 for table='testMajorCompactionFromAdmin' and column='family1' 2023-04-09 15:55:52,220 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230409 for table='testMajorCompactionFromAdmin' and column='family1' 2023-04-09 15:55:52,787 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230409836118f1604a4b1098acfbccff17015d to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230409836118f1604a4b1098acfbccff17015d 2023-04-09 15:55:52,788 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230409 table='testMajorCompactionFromAdmin' column='family1' 2023-04-09 15:55:52,849 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230409/family1/582a5bb8cdc34306bb722417ef4ee5b2 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-04-09 15:55:52,850 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230409/family1/582a5bb8cdc34306bb722417ef4ee5b2}] 2023-04-09 15:55:52,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230409/family1/582a5bb8cdc34306bb722417ef4ee5b2 for inclusion in aa3a6ed259de5fa8a0241a72444f42f8/family1 2023-04-09 15:55:52,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-04-09 15:55:52,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(777): Region bounds: first=2 last= 2023-04-09 15:55:52,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for aa3a6ed259de5fa8a0241a72444f42f8: 2023-04-09 15:55:52,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230409/family1/582a5bb8cdc34306bb722417ef4ee5b2 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionFromAdmin__5mu8l8584bn5etn5dstmnmr6ad8h97ubhkjb079fc2vp4aaecs0sgdjsft86835v/family1/582a5bb8cdc34306bb722417ef4ee5b2 2023-04-09 15:55:52,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionFromAdmin__5mu8l8584bn5etn5dstmnmr6ad8h97ubhkjb079fc2vp4aaecs0sgdjsft86835v/family1/582a5bb8cdc34306bb722417ef4ee5b2 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/cb933419ee1b4799ac3bec39ce63ec0a_SeqId_28_ 2023-04-09 15:55:52,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionFromAdmin__5mu8l8584bn5etn5dstmnmr6ad8h97ubhkjb079fc2vp4aaecs0sgdjsft86835v/family1/582a5bb8cdc34306bb722417ef4ee5b2 into aa3a6ed259de5fa8a0241a72444f42f8/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/cb933419ee1b4799ac3bec39ce63ec0a_SeqId_28_ - updating store file list. 2023-04-09 15:55:52,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/cb933419ee1b4799ac3bec39ce63ec0a_SeqId_28_ into aa3a6ed259de5fa8a0241a72444f42f8/family1 2023-04-09 15:55:52,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionFromAdmin__5mu8l8584bn5etn5dstmnmr6ad8h97ubhkjb079fc2vp4aaecs0sgdjsft86835v/family1/582a5bb8cdc34306bb722417ef4ee5b2 into aa3a6ed259de5fa8a0241a72444f42f8/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/family1/cb933419ee1b4799ac3bec39ce63ec0a_SeqId_28_) 2023-04-09 15:55:52,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionFromAdmin__5mu8l8584bn5etn5dstmnmr6ad8h97ubhkjb079fc2vp4aaecs0sgdjsft86835v/family1/582a5bb8cdc34306bb722417ef4ee5b2 2023-04-09 15:55:52,900 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230409 table='testMajorCompactionFromAdmin' column='family1' 2023-04-09 15:55:52,902 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:52,904 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023040900970e6d8e584fe1a3612ec675b0f4ea to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023040900970e6d8e584fe1a3612ec675b0f4ea 2023-04-09 15:55:52,905 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023040984b9040ad11e48e3ac8d7b15bb0a3f07 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023040984b9040ad11e48e3ac8d7b15bb0a3f07 2023-04-09 15:55:52,906 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230409e85218f82fef4de2b20b681baf0a2c48 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230409e85218f82fef4de2b20b681baf0a2c48 2023-04-09 15:55:52,907 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230409fd8e37f7bde1490197e1671ed23f172c to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230409fd8e37f7bde1490197e1671ed23f172c 2023-04-09 15:55:52,907 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-04-09 15:55:52,907 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230409' 2023-04-09 15:55:52,908 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230409 for table='testMajorCompactionFromAdmin' and column='family1' 2023-04-09 15:55:52,908 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230409 for table='testMajorCompactionFromAdmin' and column='family1' 2023-04-09 15:55:53,091 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230409721c45fd66c0479bbc98804b59939785 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230409721c45fd66c0479bbc98804b59939785 2023-04-09 15:55:53,092 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230409 table='testMajorCompactionFromAdmin' column='family1' 2023-04-09 15:55:53,148 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230409/family1/a8df790378d44e878e419d3966bd5f2c first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-04-09 15:55:53,149 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd., hostname=jenkins-hbase4.apache.org,44869,1681055618167, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230409/family1/a8df790378d44e878e419d3966bd5f2c}] 2023-04-09 15:55:53,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(763): Validating hfile at hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230409/family1/a8df790378d44e878e419d3966bd5f2c for inclusion in b21c76b97deec0852a6d87fbf137fbcd/family1 2023-04-09 15:55:53,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-04-09 15:55:53,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(777): Region bounds: first= last=1 2023-04-09 15:55:53,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegion(2446): Flush status journal for b21c76b97deec0852a6d87fbf137fbcd: 2023-04-09 15:55:53,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230409/family1/a8df790378d44e878e419d3966bd5f2c to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionFromAdmin__8uqkbhtlo3vliccc9gcub4tbcp662qa36b470n0nff8odjt2vfvm1l5d9ncbg05l/family1/a8df790378d44e878e419d3966bd5f2c 2023-04-09 15:55:53,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionFromAdmin__8uqkbhtlo3vliccc9gcub4tbcp662qa36b470n0nff8odjt2vfvm1l5d9ncbg05l/family1/a8df790378d44e878e419d3966bd5f2c as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/df671de34e314d3fbaba16592ea580fe_SeqId_28_ 2023-04-09 15:55:53,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(849): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionFromAdmin__8uqkbhtlo3vliccc9gcub4tbcp662qa36b470n0nff8odjt2vfvm1l5d9ncbg05l/family1/a8df790378d44e878e419d3966bd5f2c into b21c76b97deec0852a6d87fbf137fbcd/family1 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/df671de34e314d3fbaba16592ea580fe_SeqId_28_ - updating store file list. 2023-04-09 15:55:53,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(882): Loaded HFile hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/df671de34e314d3fbaba16592ea580fe_SeqId_28_ into b21c76b97deec0852a6d87fbf137fbcd/family1 2023-04-09 15:55:53,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.HStore(855): Successfully loaded hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionFromAdmin__8uqkbhtlo3vliccc9gcub4tbcp662qa36b470n0nff8odjt2vfvm1l5d9ncbg05l/family1/a8df790378d44e878e419d3966bd5f2c into b21c76b97deec0852a6d87fbf137fbcd/family1 (new location: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/family1/df671de34e314d3fbaba16592ea580fe_SeqId_28_) 2023-04-09 15:55:53,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44869] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/staging/jenkins__testMajorCompactionFromAdmin__8uqkbhtlo3vliccc9gcub4tbcp662qa36b470n0nff8odjt2vfvm1l5d9ncbg05l/family1/a8df790378d44e878e419d3966bd5f2c 2023-04-09 15:55:53,224 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230409 table='testMajorCompactionFromAdmin' column='family1' 2023-04-09 15:55:53,225 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:53,227 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023040931472dbb8eca4642919732ad4a3e5c9e to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023040931472dbb8eca4642919732ad4a3e5c9e 2023-04-09 15:55:53,228 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230409792a0a527309445f85b812e4a3139b71 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230409792a0a527309445f85b812e4a3139b71 2023-04-09 15:55:53,229 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230409cde93ac6aadd4dda89f4230f77fbe30b to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230409cde93ac6aadd4dda89f4230f77fbe30b 2023-04-09 15:55:53,230 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230409e4c5e229514d41a4add95720c9d6d1c6 to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230409e4c5e229514d41a4add95720c9d6d1c6 2023-04-09 15:55:53,230 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-04-09 15:55:53,230 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230409' 2023-04-09 15:55:53,232 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230409 for table='testMajorCompactionFromAdmin' and column='family1' 2023-04-09 15:55:53,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-04-09 15:55:53,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-04-09 15:55:53,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(367): [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230409b6439862ad854a3b9a61513d29683b91_del] 2023-04-09 15:55:53,233 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:53,234 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230409b6439862ad854a3b9a61513d29683b91_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230409b6439862ad854a3b9a61513d29683b91_del 2023-04-09 15:55:53,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-04-09 15:55:53,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(367): [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230409a09932862d554c39a3d30f352c29b226_del] 2023-04-09 15:55:53,234 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:53,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230409a09932862d554c39a3d30f352c29b226_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230409a09932862d554c39a3d30f352c29b226_del 2023-04-09 15:55:53,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-04-09 15:55:53,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] compactions.PartitionedMobCompactor(367): [hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202304096502e141b276406f9cf9e7b7ce3b6cc4_del] 2023-04-09 15:55:53,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] backup.HFileArchiver(360): Archiving compacted files. 2023-04-09 15:55:53,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202304096502e141b276406f9cf9e7b7ce3b6cc4_del to hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202304096502e141b276406f9cf9e7b7ce3b6cc4_del 2023-04-09 15:55:53,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-04-09 15:55:53,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1681055622347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-04-09 15:55:53,239 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-04-09 15:55:53,240 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 1.8450 sec 2023-04-09 15:55:53,254 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:53,256 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:53,260 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-04-09 15:55:53,261 DEBUG [Listener at localhost/39283] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-04-09 15:55:53,266 INFO [Listener at localhost/39283] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-04-09 15:55:53,306 INFO [Listener at localhost/39283] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=253 (was 265), OpenFileDescriptor=650 (was 652), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=369 (was 443), ProcessCount=169 (was 169), AvailableMemoryMB=1394 (was 1413) 2023-04-09 15:55:53,306 DEBUG [Listener at localhost/39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7defec53 to 127.0.0.1:64813 2023-04-09 15:55:53,306 DEBUG [Listener at localhost/39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:55:53,307 INFO [Listener at localhost/39283] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-04-09 15:55:53,307 INFO [Listener at localhost/39283] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-04-09 15:55:53,307 DEBUG [Listener at localhost/39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0629018b to 127.0.0.1:64813 2023-04-09 15:55:53,307 DEBUG [Listener at localhost/39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:55:53,308 DEBUG [Listener at localhost/39283] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-04-09 15:55:53,308 DEBUG [Listener at localhost/39283] util.JVMClusterUtil(257): Found active master hash=376350505, stopped=false 2023-04-09 15:55:53,308 INFO [Listener at localhost/39283] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33617,1681055616968 2023-04-09 15:55:53,315 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-04-09 15:55:53,316 INFO [Listener at localhost/39283] procedure2.ProcedureExecutor(629): Stopping 2023-04-09 15:55:53,315 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-04-09 15:55:53,316 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-09 15:55:53,316 DEBUG [Listener at localhost/39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b1dc256 to 127.0.0.1:64813 2023-04-09 15:55:53,316 DEBUG [Listener at localhost/39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:55:53,317 INFO [Listener at localhost/39283] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44869,1681055618167' ***** 2023-04-09 15:55:53,317 INFO [Listener at localhost/39283] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-04-09 15:55:53,318 INFO [RS:0;jenkins-hbase4:44869] regionserver.HeapMemoryManager(220): Stopping 2023-04-09 15:55:53,318 INFO [RS:0;jenkins-hbase4:44869] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-04-09 15:55:53,318 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-04-09 15:55:53,318 INFO [RS:0;jenkins-hbase4:44869] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-04-09 15:55:53,318 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for 0106df3526238973fff1bd090829f995 2023-04-09 15:55:53,319 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for b21c76b97deec0852a6d87fbf137fbcd 2023-04-09 15:55:53,319 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for 2160f8ec02730d020d47e45eb2c00ccc 2023-04-09 15:55:53,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0106df3526238973fff1bd090829f995, disabling compactions & flushes 2023-04-09 15:55:53,319 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for 38da5d3a3cb865aa14dc3d24abb615b6 2023-04-09 15:55:53,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:55:53,319 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for ff666b05ea15e96d41ce009aded55ec8 2023-04-09 15:55:53,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:55:53,319 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for ff29b220fa2e52fe8f06bb62f0a0c261 2023-04-09 15:55:53,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. after waiting 0 ms 2023-04-09 15:55:53,319 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for badd1d2631fbe3578448b9259f8df02d 2023-04-09 15:55:53,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:55:53,319 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for c2e5a80bc0a57b639d176e9f52480137 2023-04-09 15:55:53,319 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for e8d74bc0fb5ce674b95adc8cb94da50a 2023-04-09 15:55:53,319 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for 3f33dcb10aa0e9a7d71e3912baad4893 2023-04-09 15:55:53,319 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for 5edb26c74099296449ac252e8aa24185 2023-04-09 15:55:53,319 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for 4080ebf9e93974f9f93ba5eddeae10ae 2023-04-09 15:55:53,319 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for 378725acb06e17781b58c1e805e455e1 2023-04-09 15:55:53,319 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for f956cf1b99eed391208338072bc13788 2023-04-09 15:55:53,319 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for 0ae7083b5e65fccc3e4562ffb1cd8cdd 2023-04-09 15:55:53,319 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for 2720147230b846f05cd943c11531e895 2023-04-09 15:55:53,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-04-09 15:55:53,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-04-09 15:55:53,319 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for aa3a6ed259de5fa8a0241a72444f42f8 2023-04-09 15:55:53,320 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for ffe3cc2905f4a676202562918179e075 2023-04-09 15:55:53,320 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for b269a97a2863221f6ae6fdd6f4d5f399 2023-04-09 15:55:53,320 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for 77d5b71581c09b60462c27bd8b7a6175 2023-04-09 15:55:53,320 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:53,320 DEBUG [RS:0;jenkins-hbase4:44869] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56148b3d to 127.0.0.1:64813 2023-04-09 15:55:53,320 DEBUG [RS:0;jenkins-hbase4:44869] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:55:53,320 INFO [RS:0;jenkins-hbase4:44869] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-04-09 15:55:53,321 INFO [RS:0;jenkins-hbase4:44869] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-04-09 15:55:53,321 INFO [RS:0;jenkins-hbase4:44869] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-04-09 15:55:53,321 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-04-09 15:55:53,321 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-04-09 15:55:53,321 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-04-09 15:55:53,321 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-04-09 15:55:53,321 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-04-09 15:55:53,321 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-04-09 15:55:53,321 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-04-09 15:55:53,321 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-04-09 15:55:53,322 DEBUG [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(1505): Waiting on 0106df3526238973fff1bd090829f995, 0ae7083b5e65fccc3e4562ffb1cd8cdd, 1588230740, 2160f8ec02730d020d47e45eb2c00ccc, 2720147230b846f05cd943c11531e895, 378725acb06e17781b58c1e805e455e1, 38da5d3a3cb865aa14dc3d24abb615b6, 3f33dcb10aa0e9a7d71e3912baad4893, 4080ebf9e93974f9f93ba5eddeae10ae, 5edb26c74099296449ac252e8aa24185, 77d5b71581c09b60462c27bd8b7a6175, aa3a6ed259de5fa8a0241a72444f42f8, b21c76b97deec0852a6d87fbf137fbcd, b269a97a2863221f6ae6fdd6f4d5f399, badd1d2631fbe3578448b9259f8df02d, c2e5a80bc0a57b639d176e9f52480137, e8d74bc0fb5ce674b95adc8cb94da50a, f956cf1b99eed391208338072bc13788, ff29b220fa2e52fe8f06bb62f0a0c261, ff666b05ea15e96d41ce009aded55ec8, ffe3cc2905f4a676202562918179e075 2023-04-09 15:55:53,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0106df3526238973fff1bd090829f995/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-04-09 15:55:53,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:55:53,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0106df3526238973fff1bd090829f995: 2023-04-09 15:55:53,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1681055662530.0106df3526238973fff1bd090829f995. 2023-04-09 15:55:53,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b21c76b97deec0852a6d87fbf137fbcd, disabling compactions & flushes 2023-04-09 15:55:53,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:53,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:53,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. after waiting 0 ms 2023-04-09 15:55:53,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:53,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/b21c76b97deec0852a6d87fbf137fbcd/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-04-09 15:55:53,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:53,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b21c76b97deec0852a6d87fbf137fbcd: 2023-04-09 15:55:53,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1681055737996.b21c76b97deec0852a6d87fbf137fbcd. 2023-04-09 15:55:53,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2160f8ec02730d020d47e45eb2c00ccc, disabling compactions & flushes 2023-04-09 15:55:53,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. 2023-04-09 15:55:53,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. 2023-04-09 15:55:53,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. after waiting 0 ms 2023-04-09 15:55:53,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. 2023-04-09 15:55:53,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/.tmp/info/f561f676984249238e7af97963b7af98 2023-04-09 15:55:53,360 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f561f676984249238e7af97963b7af98 2023-04-09 15:55:53,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/2160f8ec02730d020d47e45eb2c00ccc/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-04-09 15:55:53,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. 2023-04-09 15:55:53,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2160f8ec02730d020d47e45eb2c00ccc: 2023-04-09 15:55:53,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1681055648048.2160f8ec02730d020d47e45eb2c00ccc. 2023-04-09 15:55:53,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 38da5d3a3cb865aa14dc3d24abb615b6, disabling compactions & flushes 2023-04-09 15:55:53,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:53,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:53,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. after waiting 0 ms 2023-04-09 15:55:53,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:53,372 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-04-09 15:55:53,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithMonthlyPolicy/38da5d3a3cb865aa14dc3d24abb615b6/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-04-09 15:55:53,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:53,377 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/.tmp/rep_barrier/24e0991be72446d4b892719eef37e63e 2023-04-09 15:55:53,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 38da5d3a3cb865aa14dc3d24abb615b6: 2023-04-09 15:55:53,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1681055729800.38da5d3a3cb865aa14dc3d24abb615b6. 2023-04-09 15:55:53,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ff666b05ea15e96d41ce009aded55ec8, disabling compactions & flushes 2023-04-09 15:55:53,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:55:53,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:55:53,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. after waiting 0 ms 2023-04-09 15:55:53,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:55:53,381 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 24e0991be72446d4b892719eef37e63e 2023-04-09 15:55:53,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyPolicy/ff666b05ea15e96d41ce009aded55ec8/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-04-09 15:55:53,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:55:53,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ff666b05ea15e96d41ce009aded55ec8: 2023-04-09 15:55:53,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1681055652035.ff666b05ea15e96d41ce009aded55ec8. 2023-04-09 15:55:53,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ff29b220fa2e52fe8f06bb62f0a0c261, disabling compactions & flushes 2023-04-09 15:55:53,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:53,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:53,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. after waiting 0 ms 2023-04-09 15:55:53,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:53,395 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/.tmp/table/d6ae294ff8cf40c4b3acc2bb5248b359 2023-04-09 15:55:53,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ff29b220fa2e52fe8f06bb62f0a0c261/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-04-09 15:55:53,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:53,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ff29b220fa2e52fe8f06bb62f0a0c261: 2023-04-09 15:55:53,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1681055713916.ff29b220fa2e52fe8f06bb62f0a0c261. 2023-04-09 15:55:53,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing badd1d2631fbe3578448b9259f8df02d, disabling compactions & flushes 2023-04-09 15:55:53,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d. 2023-04-09 15:55:53,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d. 2023-04-09 15:55:53,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d. after waiting 0 ms 2023-04-09 15:55:53,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d. 2023-04-09 15:55:53,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing badd1d2631fbe3578448b9259f8df02d 1/1 column families, dataSize=109 B heapSize=592 B 2023-04-09 15:55:53,401 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d6ae294ff8cf40c4b3acc2bb5248b359 2023-04-09 15:55:53,401 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/.tmp/info/f561f676984249238e7af97963b7af98 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/info/f561f676984249238e7af97963b7af98 2023-04-09 15:55:53,404 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-04-09 15:55:53,406 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f561f676984249238e7af97963b7af98 2023-04-09 15:55:53,406 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/info/f561f676984249238e7af97963b7af98, entries=226, sequenceid=130, filesize=37.9 K 2023-04-09 15:55:53,408 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/.tmp/rep_barrier/24e0991be72446d4b892719eef37e63e as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/rep_barrier/24e0991be72446d4b892719eef37e63e 2023-04-09 15:55:53,414 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 24e0991be72446d4b892719eef37e63e 2023-04-09 15:55:53,414 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/rep_barrier/24e0991be72446d4b892719eef37e63e, entries=1, sequenceid=130, filesize=5.0 K 2023-04-09 15:55:53,415 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/.tmp/table/d6ae294ff8cf40c4b3acc2bb5248b359 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/table/d6ae294ff8cf40c4b3acc2bb5248b359 2023-04-09 15:55:53,417 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d6ae294ff8cf40c4b3acc2bb5248b359 2023-04-09 15:55:53,418 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/table/d6ae294ff8cf40c4b3acc2bb5248b359, entries=27, sequenceid=130, filesize=6.6 K 2023-04-09 15:55:53,418 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 97ms, sequenceid=130, compaction requested=false 2023-04-09 15:55:53,423 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-04-09 15:55:53,423 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-04-09 15:55:53,424 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-04-09 15:55:53,424 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-04-09 15:55:53,424 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-04-09 15:55:53,522 DEBUG [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(1505): Waiting on 0ae7083b5e65fccc3e4562ffb1cd8cdd, 2720147230b846f05cd943c11531e895, 378725acb06e17781b58c1e805e455e1, 3f33dcb10aa0e9a7d71e3912baad4893, 4080ebf9e93974f9f93ba5eddeae10ae, 5edb26c74099296449ac252e8aa24185, 77d5b71581c09b60462c27bd8b7a6175, aa3a6ed259de5fa8a0241a72444f42f8, b269a97a2863221f6ae6fdd6f4d5f399, badd1d2631fbe3578448b9259f8df02d, c2e5a80bc0a57b639d176e9f52480137, e8d74bc0fb5ce674b95adc8cb94da50a, f956cf1b99eed391208338072bc13788, ffe3cc2905f4a676202562918179e075 2023-04-09 15:55:53,723 DEBUG [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(1505): Waiting on 0ae7083b5e65fccc3e4562ffb1cd8cdd, 2720147230b846f05cd943c11531e895, 378725acb06e17781b58c1e805e455e1, 3f33dcb10aa0e9a7d71e3912baad4893, 4080ebf9e93974f9f93ba5eddeae10ae, 5edb26c74099296449ac252e8aa24185, 77d5b71581c09b60462c27bd8b7a6175, aa3a6ed259de5fa8a0241a72444f42f8, b269a97a2863221f6ae6fdd6f4d5f399, badd1d2631fbe3578448b9259f8df02d, c2e5a80bc0a57b639d176e9f52480137, e8d74bc0fb5ce674b95adc8cb94da50a, f956cf1b99eed391208338072bc13788, ffe3cc2905f4a676202562918179e075 2023-04-09 15:55:53,813 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/namespace/badd1d2631fbe3578448b9259f8df02d/.tmp/info/33f06e4e8fa442f9a6f65c52c44df098 2023-04-09 15:55:53,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/namespace/badd1d2631fbe3578448b9259f8df02d/.tmp/info/33f06e4e8fa442f9a6f65c52c44df098 as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/namespace/badd1d2631fbe3578448b9259f8df02d/info/33f06e4e8fa442f9a6f65c52c44df098 2023-04-09 15:55:53,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/namespace/badd1d2631fbe3578448b9259f8df02d/info/33f06e4e8fa442f9a6f65c52c44df098, entries=3, sequenceid=7, filesize=4.8 K 2023-04-09 15:55:53,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for badd1d2631fbe3578448b9259f8df02d in 426ms, sequenceid=7, compaction requested=false 2023-04-09 15:55:53,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/hbase/namespace/badd1d2631fbe3578448b9259f8df02d/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-04-09 15:55:53,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d. 2023-04-09 15:55:53,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for badd1d2631fbe3578448b9259f8df02d: 2023-04-09 15:55:53,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1681055620813.badd1d2631fbe3578448b9259f8df02d. 2023-04-09 15:55:53,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c2e5a80bc0a57b639d176e9f52480137, disabling compactions & flushes 2023-04-09 15:55:53,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:55:53,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:55:53,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. after waiting 0 ms 2023-04-09 15:55:53,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:55:53,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c2e5a80bc0a57b639d176e9f52480137/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-04-09 15:55:53,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:55:53,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c2e5a80bc0a57b639d176e9f52480137: 2023-04-09 15:55:53,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1681055622520.c2e5a80bc0a57b639d176e9f52480137. 2023-04-09 15:55:53,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e8d74bc0fb5ce674b95adc8cb94da50a, disabling compactions & flushes 2023-04-09 15:55:53,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:53,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:53,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. after waiting 0 ms 2023-04-09 15:55:53,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:53,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/e8d74bc0fb5ce674b95adc8cb94da50a/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-04-09 15:55:53,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:53,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e8d74bc0fb5ce674b95adc8cb94da50a: 2023-04-09 15:55:53,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1681055713916.e8d74bc0fb5ce674b95adc8cb94da50a. 2023-04-09 15:55:53,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3f33dcb10aa0e9a7d71e3912baad4893, disabling compactions & flushes 2023-04-09 15:55:53,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:55:53,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:55:53,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. after waiting 0 ms 2023-04-09 15:55:53,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:55:53,839 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-04-09 15:55:53,839 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-04-09 15:55:53,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithMonthlyPolicy/3f33dcb10aa0e9a7d71e3912baad4893/recovered.edits/51.seqid, newMaxSeqId=51, maxSeqId=1 2023-04-09 15:55:53,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:55:53,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3f33dcb10aa0e9a7d71e3912baad4893: 2023-04-09 15:55:53,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1681055632303.3f33dcb10aa0e9a7d71e3912baad4893. 2023-04-09 15:55:53,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5edb26c74099296449ac252e8aa24185, disabling compactions & flushes 2023-04-09 15:55:53,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:53,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:53,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. after waiting 0 ms 2023-04-09 15:55:53,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:53,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/5edb26c74099296449ac252e8aa24185/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-04-09 15:55:53,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:53,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5edb26c74099296449ac252e8aa24185: 2023-04-09 15:55:53,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1681055692988.5edb26c74099296449ac252e8aa24185. 2023-04-09 15:55:53,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4080ebf9e93974f9f93ba5eddeae10ae, disabling compactions & flushes 2023-04-09 15:55:53,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. 2023-04-09 15:55:53,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. 2023-04-09 15:55:53,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. after waiting 0 ms 2023-04-09 15:55:53,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. 2023-04-09 15:55:53,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/4080ebf9e93974f9f93ba5eddeae10ae/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-04-09 15:55:53,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. 2023-04-09 15:55:53,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4080ebf9e93974f9f93ba5eddeae10ae: 2023-04-09 15:55:53,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1681055648048.4080ebf9e93974f9f93ba5eddeae10ae. 2023-04-09 15:55:53,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 378725acb06e17781b58c1e805e455e1, disabling compactions & flushes 2023-04-09 15:55:53,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:53,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:53,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. after waiting 0 ms 2023-04-09 15:55:53,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:53,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/378725acb06e17781b58c1e805e455e1/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-04-09 15:55:53,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:53,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 378725acb06e17781b58c1e805e455e1: 2023-04-09 15:55:53,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1681055737996.378725acb06e17781b58c1e805e455e1. 2023-04-09 15:55:53,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f956cf1b99eed391208338072bc13788, disabling compactions & flushes 2023-04-09 15:55:53,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:55:53,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:55:53,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. after waiting 0 ms 2023-04-09 15:55:53,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:55:53,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f956cf1b99eed391208338072bc13788/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-04-09 15:55:53,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:55:53,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f956cf1b99eed391208338072bc13788: 2023-04-09 15:55:53,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1681055673132.f956cf1b99eed391208338072bc13788. 2023-04-09 15:55:53,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0ae7083b5e65fccc3e4562ffb1cd8cdd, disabling compactions & flushes 2023-04-09 15:55:53,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:53,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:53,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. after waiting 0 ms 2023-04-09 15:55:53,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:53,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/0ae7083b5e65fccc3e4562ffb1cd8cdd/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-04-09 15:55:53,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:53,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0ae7083b5e65fccc3e4562ffb1cd8cdd: 2023-04-09 15:55:53,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1681055692988.0ae7083b5e65fccc3e4562ffb1cd8cdd. 2023-04-09 15:55:53,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2720147230b846f05cd943c11531e895, disabling compactions & flushes 2023-04-09 15:55:53,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:53,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:53,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. after waiting 0 ms 2023-04-09 15:55:53,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:53,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testCompactionWithHFileLink/2720147230b846f05cd943c11531e895/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-04-09 15:55:53,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:53,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2720147230b846f05cd943c11531e895: 2023-04-09 15:55:53,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1681055692988.2720147230b846f05cd943c11531e895. 2023-04-09 15:55:53,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing aa3a6ed259de5fa8a0241a72444f42f8, disabling compactions & flushes 2023-04-09 15:55:53,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:53,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:53,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. after waiting 0 ms 2023-04-09 15:55:53,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:53,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMajorCompactionFromAdmin/aa3a6ed259de5fa8a0241a72444f42f8/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-04-09 15:55:53,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:53,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for aa3a6ed259de5fa8a0241a72444f42f8: 2023-04-09 15:55:53,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1681055737996.aa3a6ed259de5fa8a0241a72444f42f8. 2023-04-09 15:55:53,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ffe3cc2905f4a676202562918179e075, disabling compactions & flushes 2023-04-09 15:55:53,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:53,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:53,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. after waiting 0 ms 2023-04-09 15:55:53,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:53,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/ns/testMinorCompaction/ffe3cc2905f4a676202562918179e075/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-04-09 15:55:53,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:53,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ffe3cc2905f4a676202562918179e075: 2023-04-09 15:55:53,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1681055713916.ffe3cc2905f4a676202562918179e075. 2023-04-09 15:55:53,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b269a97a2863221f6ae6fdd6f4d5f399, disabling compactions & flushes 2023-04-09 15:55:53,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:55:53,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:55:53,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. after waiting 0 ms 2023-04-09 15:55:53,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:55:53,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testMinorCompactionWithWeeklyPolicy/b269a97a2863221f6ae6fdd6f4d5f399/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-04-09 15:55:53,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:55:53,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b269a97a2863221f6ae6fdd6f4d5f399: 2023-04-09 15:55:53,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1681055640344.b269a97a2863221f6ae6fdd6f4d5f399. 2023-04-09 15:55:53,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 77d5b71581c09b60462c27bd8b7a6175, disabling compactions & flushes 2023-04-09 15:55:53,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. 2023-04-09 15:55:53,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. 2023-04-09 15:55:53,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. after waiting 0 ms 2023-04-09 15:55:53,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. 2023-04-09 15:55:53,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/data/default/testScannerOnBulkLoadRefHFiles/77d5b71581c09b60462c27bd8b7a6175/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-04-09 15:55:53,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. 2023-04-09 15:55:53,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 77d5b71581c09b60462c27bd8b7a6175: 2023-04-09 15:55:53,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1681055648048.77d5b71581c09b60462c27bd8b7a6175. 2023-04-09 15:55:53,923 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44869,1681055618167; all regions closed. 2023-04-09 15:55:53,931 DEBUG [RS:0;jenkins-hbase4:44869] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/oldWALs 2023-04-09 15:55:53,931 INFO [RS:0;jenkins-hbase4:44869] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44869%2C1681055618167.meta:.meta(num 1681055620553) 2023-04-09 15:55:53,933 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/WALs/jenkins-hbase4.apache.org,44869,1681055618167/jenkins-hbase4.apache.org%2C44869%2C1681055618167.1681055619988 not finished, retry = 0 2023-04-09 15:55:54,036 DEBUG [RS:0;jenkins-hbase4:44869] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/oldWALs 2023-04-09 15:55:54,036 INFO [RS:0;jenkins-hbase4:44869] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44869%2C1681055618167:(num 1681055619988) 2023-04-09 15:55:54,036 DEBUG [RS:0;jenkins-hbase4:44869] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:55:54,036 INFO [RS:0;jenkins-hbase4:44869] regionserver.LeaseManager(133): Closed leases 2023-04-09 15:55:54,037 INFO [RS:0;jenkins-hbase4:44869] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-04-09 15:55:54,037 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-04-09 15:55:54,042 INFO [RS:0;jenkins-hbase4:44869] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44869 2023-04-09 15:55:54,050 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-04-09 15:55:54,050 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44869,1681055618167 2023-04-09 15:55:54,050 ERROR [Listener at localhost/39283-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2c0674d3 rejected from java.util.concurrent.ThreadPoolExecutor@2839f58b[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-04-09 15:55:54,050 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-04-09 15:55:54,050 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44869,1681055618167] 2023-04-09 15:55:54,051 ERROR [Listener at localhost/39283-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43a303f2 rejected from java.util.concurrent.ThreadPoolExecutor@2839f58b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-04-09 15:55:54,051 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44869,1681055618167; numProcessing=1 2023-04-09 15:55:54,052 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44869,1681055618167 already deleted, retry=false 2023-04-09 15:55:54,052 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44869,1681055618167 expired; onlineServers=0 2023-04-09 15:55:54,052 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33617,1681055616968' ***** 2023-04-09 15:55:54,052 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-04-09 15:55:54,053 DEBUG [M:0;jenkins-hbase4:33617] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5753ad12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-04-09 15:55:54,053 INFO [M:0;jenkins-hbase4:33617] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33617,1681055616968 2023-04-09 15:55:54,053 INFO [M:0;jenkins-hbase4:33617] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33617,1681055616968; all regions closed. 2023-04-09 15:55:54,053 DEBUG [M:0;jenkins-hbase4:33617] ipc.AbstractRpcClient(494): Stopping rpc client 2023-04-09 15:55:54,053 DEBUG [M:0;jenkins-hbase4:33617] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-04-09 15:55:54,053 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-04-09 15:55:54,053 DEBUG [M:0;jenkins-hbase4:33617] cleaner.HFileCleaner(317): Stopping file delete threads 2023-04-09 15:55:54,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1681055619704] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1681055619704,5,FailOnTimeoutGroup] 2023-04-09 15:55:54,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1681055619706] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1681055619706,5,FailOnTimeoutGroup] 2023-04-09 15:55:54,054 INFO [M:0;jenkins-hbase4:33617] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-04-09 15:55:54,054 INFO [M:0;jenkins-hbase4:33617] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-04-09 15:55:54,054 INFO [M:0;jenkins-hbase4:33617] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-04-09 15:55:54,054 DEBUG [M:0;jenkins-hbase4:33617] master.HMaster(1512): Stopping service threads 2023-04-09 15:55:54,055 INFO [M:0;jenkins-hbase4:33617] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-04-09 15:55:54,055 ERROR [M:0;jenkins-hbase4:33617] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-19,5,PEWorkerGroup] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-04-09 15:55:54,056 INFO [M:0;jenkins-hbase4:33617] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-04-09 15:55:54,056 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-04-09 15:55:54,057 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-04-09 15:55:54,057 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-04-09 15:55:54,057 DEBUG [M:0;jenkins-hbase4:33617] zookeeper.ZKUtil(398): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-04-09 15:55:54,057 WARN [M:0;jenkins-hbase4:33617] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-04-09 15:55:54,057 INFO [M:0;jenkins-hbase4:33617] assignment.AssignmentManager(315): Stopping assignment manager 2023-04-09 15:55:54,057 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-04-09 15:55:54,057 INFO [M:0;jenkins-hbase4:33617] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-04-09 15:55:54,057 DEBUG [M:0;jenkins-hbase4:33617] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-04-09 15:55:54,058 INFO [M:0;jenkins-hbase4:33617] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-04-09 15:55:54,058 DEBUG [M:0;jenkins-hbase4:33617] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-04-09 15:55:54,058 DEBUG [M:0;jenkins-hbase4:33617] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-04-09 15:55:54,058 DEBUG [M:0;jenkins-hbase4:33617] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-04-09 15:55:54,058 INFO [M:0;jenkins-hbase4:33617] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.70 KB heapSize=598.89 KB 2023-04-09 15:55:54,155 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-04-09 15:55:54,155 INFO [RS:0;jenkins-hbase4:44869] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44869,1681055618167; zookeeper connection closed. 2023-04-09 15:55:54,155 ERROR [Listener at localhost/39283-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3b6e741c rejected from java.util.concurrent.ThreadPoolExecutor@2839f58b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-04-09 15:55:54,155 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): regionserver:44869-0x10169a0f6310001, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-04-09 15:55:54,155 ERROR [Listener at localhost/39283-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5673bf64 rejected from java.util.concurrent.ThreadPoolExecutor@2839f58b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-04-09 15:55:54,155 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@654d7719] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@654d7719 2023-04-09 15:55:54,156 INFO [Listener at localhost/39283] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-04-09 15:55:54,475 INFO [M:0;jenkins-hbase4:33617] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.70 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/76bdacb541f74cabab78a43c1df0179e 2023-04-09 15:55:54,480 INFO [M:0;jenkins-hbase4:33617] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 76bdacb541f74cabab78a43c1df0179e 2023-04-09 15:55:54,480 DEBUG [M:0;jenkins-hbase4:33617] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/76bdacb541f74cabab78a43c1df0179e as hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/76bdacb541f74cabab78a43c1df0179e 2023-04-09 15:55:54,487 INFO [M:0;jenkins-hbase4:33617] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 76bdacb541f74cabab78a43c1df0179e 2023-04-09 15:55:54,487 INFO [M:0;jenkins-hbase4:33617] regionserver.HStore(1080): Added hdfs://localhost:37243/user/jenkins/test-data/cf76a8ab-2cab-73bc-d589-ded33a45c3f9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/76bdacb541f74cabab78a43c1df0179e, entries=123, sequenceid=1011, filesize=33.3 K 2023-04-09 15:55:54,488 INFO [M:0;jenkins-hbase4:33617] regionserver.HRegion(2948): Finished flush of dataSize ~512.70 KB/525006, heapSize ~598.88 KB/613248, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 430ms, sequenceid=1011, compaction requested=false 2023-04-09 15:55:54,488 INFO [M:0;jenkins-hbase4:33617] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-04-09 15:55:54,489 DEBUG [M:0;jenkins-hbase4:33617] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-04-09 15:55:54,493 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-04-09 15:55:54,493 INFO [M:0;jenkins-hbase4:33617] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-04-09 15:55:54,494 INFO [M:0;jenkins-hbase4:33617] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33617 2023-04-09 15:55:54,496 DEBUG [M:0;jenkins-hbase4:33617] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33617,1681055616968 already deleted, retry=false 2023-04-09 15:55:54,598 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-04-09 15:55:54,598 INFO [M:0;jenkins-hbase4:33617] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33617,1681055616968; zookeeper connection closed. 2023-04-09 15:55:54,598 ERROR [Listener at localhost/39283-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c420a9 rejected from java.util.concurrent.ThreadPoolExecutor@36c7212e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 903] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-04-09 15:55:54,598 DEBUG [Listener at localhost/39283-EventThread] zookeeper.ZKWatcher(600): master:33617-0x10169a0f6310000, quorum=127.0.0.1:64813, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-04-09 15:55:54,598 ERROR [Listener at localhost/39283-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6e77a10 rejected from java.util.concurrent.ThreadPoolExecutor@36c7212e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 903] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-04-09 15:55:54,600 WARN [Listener at localhost/39283] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-04-09 15:55:54,604 INFO [Listener at localhost/39283] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-04-09 15:55:54,718 WARN [BP-748898159-172.31.14.131-1681055613654 heartbeating to localhost/127.0.0.1:37243] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-04-09 15:55:54,718 WARN [BP-748898159-172.31.14.131-1681055613654 heartbeating to localhost/127.0.0.1:37243] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-748898159-172.31.14.131-1681055613654 (Datanode Uuid 4cfc1ac7-51a3-4a20-8e9d-d4fea3780500) service to localhost/127.0.0.1:37243 2023-04-09 15:55:54,726 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/cluster_6f150c66-096a-4a5e-360e-e20deca6fb86/dfs/data/data2/current/BP-748898159-172.31.14.131-1681055613654] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-04-09 15:55:54,726 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/932cb87b-ec6c-9219-2697-94cbfbeb9404/cluster_6f150c66-096a-4a5e-360e-e20deca6fb86/dfs/data/data1/current/BP-748898159-172.31.14.131-1681055613654] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-04-09 15:55:54,777 INFO [Listener at localhost/39283] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-04-09 15:55:54,909 INFO [Listener at localhost/39283] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-04-09 15:55:55,026 INFO [Listener at localhost/39283] hbase.HBaseTestingUtility(1293): Minicluster is down